nirbarazida/promptfoo

Michael 6d13ffa10a

chore(redteam): regenerate sessionId for each iteration in single-turn strategies (#4835)

1 month ago

Commits

openai-agents

c514791528

chore(deps): update all example dependencies to latest versions (#4900)

1 month ago

openai-audio

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

openai-chat-history

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

openai-dalle-images

874d93b56e

docs: Update example configs with descriptions (#4283)

2 months ago

openai-eval-factuality

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

openai-function-call

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

openai-gpt-4.1-vs-gpt-4o-mmlu

a39b48847a

docs(guides): add GPT-4.1 vs GPT-4o MMLU comparison guide (#4399)

2 months ago

openai-mcp

d7383bb6ee

feat(providers): add OpenAI MCP (Model Context Protocol) support to Responses API (#4180)

3 months ago

openai-multiline-yaml

becfa34b34

docs: standardize file references to use file:// scheme (#4291)

2 months ago

openai-realtime

b5f0766391

chore(deps): update minor and patch dependencies (#4686)

1 month ago

openai-responses

618e46d958

docs(openai): remove gpt-4.5-preview references after API deprecation (#5005)

1 month ago

openai-structured-output

c66b94fe31

docs(openai): update structured output external schema file example (#3967)

3 months ago

openai-tools-call

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

openai-vision

874d93b56e

docs: Update example configs with descriptions (#4283)

2 months ago

opentelemetry-tracing

c514791528

chore(deps): update all example dependencies to latest versions (#4900)

1 month ago

pdf-variables

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

perplexity.ai-example

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

phi-vs-llama

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

portkey-test

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

prompt-labels

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

prompts-per-model

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

provider-aiml-api

faebffa478

chore(providers): update aiml integration (#4751)

1 month ago

pydantic-ai

c514791528

chore(deps): update all example dependencies to latest versions (#4900)

1 month ago

python-assert

9fcd246ad7

docs(examples): consolidate python-assert examples into unified folder (#4588)

2 months ago

python-provider

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

python-test-cases

c592fdb629

feat(tests): add configuration support for test generators (#4301)

2 months ago

rag-eval

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

rag-full

c514791528

chore(deps): update all example dependencies to latest versions (#4900)

1 month ago

redteam-azure-assistant

b5f0766391

chore(deps): update minor and patch dependencies (#4686)

1 month ago

redteam-beavertails

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

redteam-bestOfN-strategy

5b3fcfb728

chore: Add README for missing examples (#4404)

2 months ago

redteam-chatbot

6d13ffa10a

chore(redteam): regenerate sessionId for each iteration in single-turn strategies (#4835)

1 month ago

redteam-custom-strategy

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

redteam-dalle

b5f0766391

chore(deps): update minor and patch dependencies (#4686)

1 month ago

redteam-deepseek

be46a6d2fd

chore(examples): Add mischievous-user strategy to redteam multi-turn examples (#4837)

1 month ago

redteam-deepseek-foundation

2168594429

docs: "red team" two words (#3798)

4 months ago

redteam-foundation-model

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

redteam-guardrails

d492a4b6e8

chore: add preset for guardrails eval (#4640)

1 month ago

redteam-intent-sequence

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

redteam-langchain

020fdbec9e

chore: bump aiohttp from 3.11.11 to 3.12.14 in /examples/redteam-langchain in the pip group across 1 directory (#4922)

1 month ago

redteam-mcp

abf1612226

docs(providers): remove deprecated claude-3-sonnet-20240229 model references (#5018)

1 month ago

redteam-medical-agent

be46a6d2fd

chore(examples): Add mischievous-user strategy to redteam multi-turn examples (#4837)

1 month ago

redteam-minimal

5b3fcfb728

chore: Add README for missing examples (#4404)

2 months ago

redteam-multi-modal

b5f0766391

chore(deps): update minor and patch dependencies (#4686)

1 month ago

redteam-ollama

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

redteam-provider-override

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

redteam-rag

be46a6d2fd

chore(examples): Add mischievous-user strategy to redteam multi-turn examples (#4837)

1 month ago

redteam-starter

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

redteam-travel-agent

be46a6d2fd

chore(examples): Add mischievous-user strategy to redteam multi-turn examples (#4837)

1 month ago

replicate-lifeboat

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

replicate-llama2

874d93b56e

docs: Update example configs with descriptions (#4283)

2 months ago

select-best-example

874d93b56e

docs: Update example configs with descriptions (#4283)

2 months ago

self-grading

874d93b56e

docs: Update example configs with descriptions (#4283)

2 months ago

separate-test-configs

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

simple-cli

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

simple-csv

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

simple-mcp

c514791528

chore(deps): update all example dependencies to latest versions (#4900)

1 month ago

simple-test

becfa34b34

docs: standardize file references to use file:// scheme (#4291)

2 months ago

sql-validation

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

standalone-assertions

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

store-and-reuse-outputs

874d93b56e

docs: Update example configs with descriptions (#4283)

2 months ago

structured-outputs-config

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

summarization

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

tau-simulated-user

8b3118b68b

chore: update tau-simulated-user docs and example (#4468)

2 months ago

test-markdown

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

tool-use

183754ccb7

feat(assertion): add finish reason as assertion option (#3879)

1 month ago

transform-file

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

ts-config

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

vars-referencing-vars

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

voyage-embeddings

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

watsonx

360d7b519d

docs(examples): add uniform init commands to all example READMEs (#4068)

3 months ago

websockets

c514791528

chore(deps): update all example dependencies to latest versions (#4900)

1 month ago

xai

c97a6d8812

feat(providers): add grok-4 support (#4855)

1 month ago

xstest

fc4a6bbc7d

docs(examples): update model references from gpt-4o-mini to gpt-4.1-mini (#4289)

2 months ago

Comments

Use AWS S3 as storage!

Specify your S3 bucket

Access key (If needed)

Congratulations!

Use Google Cloud Storage!

Specify your Google Storage bucket

Service Account Key

Congratulations!

Use Azure Cloud Storage!

Specify your Azure Storage bucket

Access key (If needed)

Congratulations!

Use any S3 compatible storage!

Specify your S3 bucket

Access key (If needed)

Congratulations!

nirbarazida / promptfoo mirror of https://github.com/promptfoo/promptfoo

Comments

Use AWS S3 as storage!

Specify your S3 bucket

Access key (If needed)

Congratulations!

Use Google Cloud Storage!

Specify your Google Storage bucket

Service Account Key

Congratulations!

Use Azure Cloud Storage!

Specify your Azure Storage bucket

Access key (If needed)

Congratulations!

Use any S3 compatible storage!

Specify your S3 bucket

Access key (If needed)

Congratulations!

nirbarazida
/
promptfoo
mirror of https://github.com/promptfoo/promptfoo