nirbarazida/promptfoo

Michael D'Angelo 6f9ec0176f

update

2 months ago

Commits

adaline-gateway

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

amazon-bedrock

7857266c65

chore(providers): add Claude 4 support to anthropic, bedrock, and vertex providers (#4129)

3 months ago

amazon-sagemaker

fcf6ac48f9

feat(providers): add support for Amazon SageMaker (#3413)

5 months ago

assertion-scoring-override

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

assistant-cli

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

azure-openai

874d93b56e

docs: Update example configs with descriptions (#4283)

2 months ago

azure-openai-assistant

2e0e636bfb

docs(azure-example): update assistant prompts and test cases (#3529)

5 months ago

cerebras

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

claude-thinking

7857266c65

chore(providers): add Claude 4 support to anthropic, bedrock, and vertex providers (#4129)

3 months ago

claude-vision

874d93b56e

docs: Update example configs with descriptions (#4283)

2 months ago

claude-vs-gpt

7857266c65

chore(providers): add Claude 4 support to anthropic, bedrock, and vertex providers (#4129)

3 months ago

claude-vs-gpt-image

becfa34b34

docs: standardize file references to use file:// scheme (#4291)

2 months ago

cloudflare-ai

1f15e05d88

docs: add schema header to example configs (#4277)

2 months ago

cohere

874d93b56e

docs: Update example configs with descriptions (#4283)

2 months ago

cohere-benchmark

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

colab-notebook

5b3fcfb728

chore: Add README for missing examples (#4404)

2 months ago

csv-metadata

874d93b56e

docs: Update example configs with descriptions (#4283)

2 months ago

custom-grader-csv

f165990574

docs(examples): fix custom-grader-csv README inconsistencies (#4474)

2 months ago

custom-grading-prompt

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

custom-prompt-function

becfa34b34

docs: standardize file references to use file:// scheme (#4291)

2 months ago

custom-provider

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

custom-provider-embeddings

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

custom-provider-mjs

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

custom-provider-typescript

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

cyberseceval

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

dbrx-benchmark

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

deepseek-r1-vs-openai-o1

1f15e05d88

docs: add schema header to example configs (#4277)

2 months ago

docker-code-generation-sandbox

98488d06c3

chore: bump urllib3 from 1.26.19 to 2.5.0 in /examples/docker-code-generation-sandbox in the pip group across 1 directory (#4556)

2 months ago

donotanswer

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

dynamic-var

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

errors-vs-failures

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

extension-api

4cbf0cbf30

chore(eval): Adds first-class support for `beforeAll` and `beforeEach` extension hooks mutation of context (#4197)

2 months ago

external-provider-config

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

f-score

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

fal-image-generation

5e3223a2cb

chore(providers): update fal provider (#4182)

3 months ago

function-tools-callback

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

g-eval

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

gemma-vs-llama

874d93b56e

docs: Update example configs with descriptions (#4283)

2 months ago

gemma-vs-mistral

874d93b56e

docs: Update example configs with descriptions (#4283)

2 months ago

getting-started

b45f1d59c8

docs: update getting-started example (#4346)

2 months ago

github-action

5b3fcfb728

chore: Add README for missing examples (#4404)

2 months ago

golang-provider

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

google-aistudio-gemini

f831037456

chore(providers): document support for loading system instructions from files (#4582)

2 months ago

google-aistudio-tools

3b8baeffcb

feat(providers): support Google Search grounding (#3800)

4 months ago

google-live

becfa34b34

docs: standardize file references to use file:// scheme (#4291)

2 months ago

google-live-audio

8dd32a6feb

feat: Google live audio output (#4280)

2 months ago

google-sheets

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

google-vertex

9922840ebe

chore: update gemini models to include latest 2.5 pro preview and flash models (#4499)

2 months ago

google-vertex-tools

d61e341c6d

docs(examples): consolidate google-vertex-tools examples (#4587)

2 months ago

gpt-4o-temperature-comparison

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

gpt-4o-vs-4o-mini

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

groq

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

harmbench

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

headless-browser

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

http-provider

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

http-provider-auth-signature

7724d2cf57

chore: upgrade Express to v5.1.0 (#4378)

2 months ago

huggingface-dataset

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

huggingface-dataset-factuality

c592fdb629

feat(tests): add configuration support for test generators (#4301)

2 months ago

huggingface-hate-speech-detection

874d93b56e

docs: Update example configs with descriptions (#4283)

2 months ago

huggingface-inference-endpoint

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

huggingface-pii

874d93b56e

docs: Update example configs with descriptions (#4283)

2 months ago

huggingface-similarity

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

ibm-granite-vs-llama

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

image-classification

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

javascript-assert-external

874d93b56e

docs: Update example configs with descriptions (#4283)

2 months ago

javascript-test-cases

c592fdb629

feat(tests): add configuration support for test generators (#4301)

2 months ago

jest-integration

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

js-config

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

json-output

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

jsonl-test-cases

874d93b56e

docs: Update example configs with descriptions (#4283)

2 months ago

lambdalabs

598e71c089

feat(providers): add Lambda Labs integration (#3601)

4 months ago

langchain-python

becfa34b34

docs: standardize file references to use file:// scheme (#4291)

2 months ago

llama-cpp

874d93b56e

docs: Update example configs with descriptions (#4283)

2 months ago

llama-gpt-comparison

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

lm-studio

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

mistral

acd51ac2bc

feat(providers): add Mistral Magistral reasoning models (#4435)

2 months ago

mistral-llama-comparison

874d93b56e

docs: Update example configs with descriptions (#4283)

2 months ago

moderation

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

multiple-configs

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

multiple-translations

193cf868e6

docs(examples): consolidate translation examples (#4590)

2 months ago

multiple-turn-conversation

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

multishot

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

named-metrics

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

node-module-package

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

node-package

5b3fcfb728

chore: Add README for missing examples (#4404)

2 months ago

node-package-typescript

5b3fcfb728

chore: Add README for missing examples (#4404)

2 months ago

nunjucks-custom-filters

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

ollama-comparison

becfa34b34

docs: standardize file references to use file:// scheme (#4291)

2 months ago

openai-agents

bfa8a39a8a

docs(examples): add OpenAI Agents SDK example (#4006)

3 months ago

openai-audio

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

openai-chat-history

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

openai-dalle-images

874d93b56e

docs: Update example configs with descriptions (#4283)

2 months ago

openai-eval-factuality

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

openai-function-call

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

openai-gpt-4.1-vs-gpt-4o-mmlu

a39b48847a

docs(guides): add GPT-4.1 vs GPT-4o MMLU comparison guide (#4399)

2 months ago

openai-mcp

d7383bb6ee

feat(providers): add OpenAI MCP (Model Context Protocol) support to Responses API (#4180)

3 months ago

openai-multiline-yaml

becfa34b34

docs: standardize file references to use file:// scheme (#4291)

2 months ago

openai-realtime

50676d0d5f

feat(providers): add support for openai realtime api (#3383)

5 months ago

openai-responses

56eb4524e7

chore(providers): add additional parameters to openai models (#4502)

2 months ago

openai-structured-output

c66b94fe31

docs(openai): update structured output external schema file example (#3967)

3 months ago

Comments

Use AWS S3 as storage!

Specify your S3 bucket

Access key (If needed)

Congratulations!

Use Google Cloud Storage!

Specify your Google Storage bucket

Service Account Key

Congratulations!

Use Azure Cloud Storage!

Specify your Azure Storage bucket

Access key (If needed)

Congratulations!

Use any S3 compatible storage!

Specify your S3 bucket

Access key (If needed)

Congratulations!

nirbarazida / promptfoo mirror of https://github.com/promptfoo/promptfoo

Comments

Use AWS S3 as storage!

Specify your S3 bucket

Access key (If needed)

Congratulations!

Use Google Cloud Storage!

Specify your Google Storage bucket

Service Account Key

Congratulations!

Use Azure Cloud Storage!

Specify your Azure Storage bucket

Access key (If needed)

Congratulations!

Use any S3 compatible storage!

Specify your S3 bucket

Access key (If needed)

Congratulations!

nirbarazida
/
promptfoo
mirror of https://github.com/promptfoo/promptfoo