nirbarazida/promptfoo

Michael a10a86adb1

fix: OpenAI Responses API function callbacks and Azure implementation (#5176)

2 weeks ago

Commits

multishot

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

named-metrics

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

node-module-package

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

node-package

5b3fcfb728

chore: Add README for missing examples (#4404)

2 months ago

node-package-typescript

5b3fcfb728

chore: Add README for missing examples (#4404)

2 months ago

nunjucks-custom-filters

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

ollama-comparison

6ace43376b

docs: update Ollama documentation with latest models and defaultTest guidance (#5084)

3 weeks ago

openai-agents

c514791528

chore(deps): update all example dependencies to latest versions (#4900)

1 month ago

openai-audio

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

openai-chat-history

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

openai-dalle-images

874d93b56e

docs: Update example configs with descriptions (#4283)

2 months ago

openai-deep-research

2fd448548e

feat: add support for OpenAI deep research models (#4661)

4 weeks ago

openai-eval-factuality

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

openai-function-call

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

openai-gpt-4.1-vs-gpt-4o-mmlu

a39b48847a

docs(guides): add GPT-4.1 vs GPT-4o MMLU comparison guide (#4399)

2 months ago

openai-mcp

d7383bb6ee

feat(providers): add OpenAI MCP (Model Context Protocol) support to Responses API (#4180)

2 months ago

openai-multiline-yaml

becfa34b34

docs: standardize file references to use file:// scheme (#4291)

2 months ago

openai-realtime

b5f0766391

chore(deps): update minor and patch dependencies (#4686)

1 month ago

openai-responses

a10a86adb1

fix: OpenAI Responses API function callbacks and Azure implementation (#5176)

2 weeks ago

openai-structured-output

dfaf4d1575

feat: GPT-5 support (#5205)

2 weeks ago

openai-tools-call

dc869b17cd

chore: support verbosity and reasoning params for gpt5 (#5207)

2 weeks ago

openai-vision

874d93b56e

docs: Update example configs with descriptions (#4283)

2 months ago

opentelemetry-tracing

3e3b7539b6

chore: update dependencies to latest minor and patch versions (#5109)

3 weeks ago

pdf-variables

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

perplexity.ai-example

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

phi-vs-llama

6ace43376b

docs: update Ollama documentation with latest models and defaultTest guidance (#5084)

3 weeks ago

portkey-test

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

prompt-labels

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

prompts-per-model

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

provider-aiml-api

faebffa478

chore(providers): update aiml integration (#4751)

1 month ago

pydantic-ai

c514791528

chore(deps): update all example dependencies to latest versions (#4900)

1 month ago

python-assert

9fcd246ad7

docs(examples): consolidate python-assert examples into unified folder (#4588)

2 months ago

python-provider

647d9c11d7

chore: update dependencies to latest minor/patch versions (#5173)

2 weeks ago

python-test-cases

c592fdb629

feat(tests): add configuration support for test generators (#4301)

2 months ago

rag-eval

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

rag-full

c514791528

chore(deps): update all example dependencies to latest versions (#4900)

1 month ago

redteam-azure-assistant

b5f0766391

chore(deps): update minor and patch dependencies (#4686)

1 month ago

redteam-beavertails

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

redteam-bestOfN-strategy

5b3fcfb728

chore: Add README for missing examples (#4404)

2 months ago

redteam-chatbot

3e3b7539b6

chore: update dependencies to latest minor and patch versions (#5109)

3 weeks ago

redteam-custom-strategy

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

redteam-dalle

b5f0766391

chore(deps): update minor and patch dependencies (#4686)

1 month ago

redteam-deepseek

be46a6d2fd

chore(examples): Add mischievous-user strategy to redteam multi-turn examples (#4837)

1 month ago

redteam-deepseek-foundation

2168594429

docs: "red team" two words (#3798)

4 months ago

redteam-foundation-model

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

redteam-guardrails

d492a4b6e8

chore: add preset for guardrails eval (#4640)

1 month ago

redteam-intent-sequence

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

redteam-langchain

020fdbec9e

chore: bump aiohttp from 3.11.11 to 3.12.14 in /examples/redteam-langchain in the pip group across 1 directory (#4922)

1 month ago

redteam-mcp

abf1612226

docs(providers): remove deprecated claude-3-sonnet-20240229 model references (#5018)

1 month ago

redteam-medical-agent

3e3b7539b6

chore: update dependencies to latest minor and patch versions (#5109)

3 weeks ago

redteam-minimal

5b3fcfb728

chore: Add README for missing examples (#4404)

2 months ago

redteam-multi-modal

b5f0766391

chore(deps): update minor and patch dependencies (#4686)

1 month ago

redteam-ollama

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

redteam-provider-override

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

redteam-rag

be46a6d2fd

chore(examples): Add mischievous-user strategy to redteam multi-turn examples (#4837)

1 month ago

redteam-starter

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

redteam-travel-agent

be46a6d2fd

chore(examples): Add mischievous-user strategy to redteam multi-turn examples (#4837)

1 month ago

replicate-comprehensive

a42b717657

chore: update replicate provider (#5085)

3 weeks ago

replicate-image-generation

a42b717657

chore: update replicate provider (#5085)

3 weeks ago

replicate-lifeboat

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

replicate-llama-guard-moderation

a42b717657

chore: update replicate provider (#5085)

3 weeks ago

replicate-llama4-scout

a42b717657

chore: update replicate provider (#5085)

3 weeks ago

replicate-quickstart

a42b717657

chore: update replicate provider (#5085)

3 weeks ago

select-best-example

874d93b56e

docs: Update example configs with descriptions (#4283)

2 months ago

self-grading

874d93b56e

docs: Update example configs with descriptions (#4283)

2 months ago

separate-test-configs

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

simple-cli

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

simple-csv

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

simple-mcp

3e3b7539b6

chore: update dependencies to latest minor and patch versions (#5109)

3 weeks ago

simple-test

dfaf4d1575

feat: GPT-5 support (#5205)

2 weeks ago

sql-validation

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

standalone-assertions

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

store-and-reuse-outputs

874d93b56e

docs: Update example configs with descriptions (#4283)

2 months ago

structured-outputs-config

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

summarization

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

tau-simulated-user

8b3118b68b

chore: update tau-simulated-user docs and example (#4468)

2 months ago

test-markdown

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

tool-use

183754ccb7

feat(assertion): add finish reason as assertion option (#3879)

1 month ago

transform-file

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

ts-config

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

vars-referencing-vars

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

voyage-embeddings

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

watsonx

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

websockets

c514791528

chore(deps): update all example dependencies to latest versions (#4900)

1 month ago

xai

c97a6d8812

feat(providers): add grok-4 support (#4855)

1 month ago

xstest

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

Comments

Use AWS S3 as storage!

Specify your S3 bucket

Access key (If needed)

Congratulations!

Use Google Cloud Storage!

Specify your Google Storage bucket

Service Account Key

Congratulations!

Use Azure Cloud Storage!

Specify your Azure Storage bucket

Access key (If needed)

Congratulations!

Use any S3 compatible storage!

Specify your S3 bucket

Access key (If needed)

Congratulations!

nirbarazida / promptfoo mirror of https://github.com/promptfoo/promptfoo

Comments

Use AWS S3 as storage!

Specify your S3 bucket

Access key (If needed)

Congratulations!

Use Google Cloud Storage!

Specify your Google Storage bucket

Service Account Key

Congratulations!

Use Azure Cloud Storage!

Specify your Azure Storage bucket

Access key (If needed)

Congratulations!

Use any S3 compatible storage!

Specify your S3 bucket

Access key (If needed)

Congratulations!

nirbarazida
/
promptfoo
mirror of https://github.com/promptfoo/promptfoo