nirbarazida/promptfoo

Michael 0970efdd03

chore: add vision grading example (#4090)

3 months ago

Commits

adaline-gateway

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

amazon-bedrock

59b3d1cbc8

chore: add support for Amazon Nova Premier model (#3951)

3 months ago

amazon-sagemaker

fcf6ac48f9

feat(providers): add support for Amazon SageMaker (#3413)

5 months ago

assertion-scoring-override

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

assistant-cli

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

azure-openai

c6024f512f

chore(providers): improve support for azure reasoning models and update documentation (#3332)

5 months ago

azure-openai-assistant

2e0e636bfb

docs(azure-example): update assistant prompts and test cases (#3529)

4 months ago

cerebras

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

claude-thinking

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

claude-vision

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

claude-vs-gpt

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

claude-vs-gpt-image

0970efdd03

chore: add vision grading example (#4090)

3 months ago

cloudflare-ai

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

cohere

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

cohere-benchmark

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

colab-notebook

6bbaf876e7

docs(press): add dedicated press page (#2990)

6 months ago

csv-metadata

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

custom-grader-csv

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

custom-grading-prompt

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

custom-prompt-function

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

custom-provider

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

custom-provider-embeddings

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

custom-provider-mjs

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

custom-provider-typescript

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

cyberseceval

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

dbrx-benchmark

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

deepseek-r1-vs-openai-o1

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

docker-code-generation-sandbox

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

donotanswer

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

dynamic-var

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

errors-vs-failures

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

extension-api

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

external-provider-config

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

f-score

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

function-tools-callback

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

g-eval

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

gemma-vs-llama

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

gemma-vs-mistral

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

getting-started

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

github-action

2ac593c9cb

chore: Fix formatting and add style check to CI (#872)

1 year ago

golang-provider

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

google-aistudio-gemini

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

google-aistudio-tools

3b8baeffcb

feat(providers): support Google Search grounding (#3800)

3 months ago

google-live

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

google-sheets

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

google-vertex

983a9e1b5d

docs(google-vertex): fix duplicate readme (#3979)

3 months ago

google-vertex-tools

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

google-vertex-tools-callback

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

gpt-4o-temperature-comparison

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

gpt-4o-vs-4o-mini

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

groq

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

harmbench

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

headless-browser

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

http-provider

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

http-provider-auth-signature

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

huggingface-dataset

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

huggingface-dataset-factuality

3e6b2eeb3c

feat(assertions): update factuality grading prompt to improve compatibility across many different providers (#3408)

5 months ago

huggingface-hate-speech-detection

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

huggingface-inference-endpoint

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

huggingface-pii

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

huggingface-similarity

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

ibm-granite-vs-llama

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

image-classification

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

javascript-assert-external

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

javascript-test-cases

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

jest-integration

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

js-config

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

json-output

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

jsonl-test-cases

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

lambdalabs

598e71c089

feat(providers): add Lambda Labs integration (#3601)

4 months ago

langchain-python

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

llama-cpp

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

llama-gpt-comparison

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

lm-studio

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

mistral

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

mistral-llama-comparison

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

moderation

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

multiple-configs

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

multiple-translations

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

multiple-translations-scenarios

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

multiple-turn-conversation

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

multishot

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

named-metrics

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

node-module-package

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

node-package

21f4d639b2

docs: update model references from gpt-3.5-turbo to gpt-4o-mini (#1655)

11 months ago

node-package-typescript

ad33256d02

chore: enforce consistent type imports (#1341)

1 year ago

nunjucks-custom-filters

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

ollama-comparison

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

openai-agents

bfa8a39a8a

docs(examples): add OpenAI Agents SDK example (#4006)

3 months ago

openai-audio

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

openai-chat-history

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

openai-dalle-images

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

openai-eval-factuality

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

openai-function-call

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

openai-multiline-yaml

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

openai-realtime

50676d0d5f

feat(providers): add support for openai realtime api (#3383)

5 months ago

openai-responses

d6bc5a54d4

chore(providers): Adds support for openai `codex-mini-latest` (#4041)

3 months ago

openai-structured-output

c66b94fe31

docs(openai): update structured output external schema file example (#3967)

3 months ago

openai-tools-call

63dea63a93

feat(providers): add support for o3 and o4-mini reasoning model (#3727)

4 months ago

openai-vision

63dea63a93

feat(providers): add support for o3 and o4-mini reasoning model (#3727)

4 months ago

Comments

Use AWS S3 as storage!

Specify your S3 bucket

Access key (If needed)

Congratulations!

Use Google Cloud Storage!

Specify your Google Storage bucket

Service Account Key

Congratulations!

Use Azure Cloud Storage!

Specify your Azure Storage bucket

Access key (If needed)

Congratulations!

Use any S3 compatible storage!

Specify your S3 bucket

Access key (If needed)

Congratulations!

nirbarazida / promptfoo mirror of https://github.com/promptfoo/promptfoo

Comments

Use AWS S3 as storage!

Specify your S3 bucket

Access key (If needed)

Congratulations!

Use Google Cloud Storage!

Specify your Google Storage bucket

Service Account Key

Congratulations!

Use Azure Cloud Storage!

Specify your Azure Storage bucket

Access key (If needed)

Congratulations!

Use any S3 compatible storage!

Specify your S3 bucket

Access key (If needed)

Congratulations!

nirbarazida
/
promptfoo
mirror of https://github.com/promptfoo/promptfoo