nirbarazida/promptfoo

Ian Webster 9ab1445567

docs: add red team github action info (#5294)

5 days ago

Commits

burp

dfeb472697

chore: burp docs, improvements, and ui (#2818)

7 months ago

cloud

e0880b7251

docs: service accounts (#2984)

6 months ago

crewai

0247f4672f

docs: Add examples for gemini URL context and code execution tools (#4923)

1 month ago

grading

647f9da3a9

docs: updates to grading documentation (#3848)

3 months ago

mcp

699805e609

docs: add mcp testing guide (#4846)

1 month ago

modelaudit

aaf9d57bb3

feat: Static model scanning UI (#4368)

2 months ago

redteam

a98e5db0cd

fix(redteam): make image jailbreak strategy runnable (#3361)

5 months ago

setup

56c81269d3

docs: update app details (#2734)

7 months ago

ai-security-map.png

b6b2dedcef

site: enterprise blog post (#1497)

1 year ago

artprompt.png

846993f796

docs: red team intro (#1662)

11 months ago

best-of-n-cycle.svg

91a8a129a8

feat: best-of-n jailbreak (#2495)

8 months ago

chevy1.png

846993f796

docs: red team intro (#1662)

11 months ago

chevy2.png

846993f796

docs: red team intro (#1662)

11 months ago

claude3-result-details.png

a3b36db1c0

site: landing page updates (#1096)

1 year ago

claude3-vs-gpt4-expanded.png

a3b36db1c0

site: landing page updates (#1096)

1 year ago

claude3-vs-gpt4-latency.png

a3b36db1c0

site: landing page updates (#1096)

1 year ago

claude3-vs-gpt4.png

a3b36db1c0

site: landing page updates (#1096)

1 year ago

claude3.5-vs-gpt4o.png

a3b36db1c0

site: landing page updates (#1096)

1 year ago

clyde-jailbreak.jpg

4ef4ab7310

docs: redteam case study

11 months ago

code-generation-webui.png

a3b36db1c0

site: landing page updates (#1096)

1 year ago

cohere-details.png

a3b36db1c0

site: landing page updates (#1096)

1 year ago

cohere-gpt-claude.png

a3b36db1c0

site: landing page updates (#1096)

1 year ago

compliance.png

a7f5e1faaf

docs: owasp illustrations (#2615)

7 months ago

cross-session-leak.png

02f1c9b21b

site: about page (#1715)

11 months ago

cyberseceval-flow.svg

eeac2a7000

feat: cyberseceval plugin (#2523)

7 months ago

dbrx-mixtral-gpt-comparison-details.png

a3b36db1c0

site: landing page updates (#1096)

1 year ago

dbrx-mixtral-gpt-comparison-failures.png

a3b36db1c0

site: landing page updates (#1096)

1 year ago

dbrx-mixtral-gpt-comparison.png

a3b36db1c0

site: landing page updates (#1096)

1 year ago

donotanswer-details.png

5bd0a33ae2

feat: donotanswer plugin (#3754)

4 months ago

donotanswer-eval.png

5bd0a33ae2

feat: donotanswer plugin (#3754)

4 months ago

eating-glue.png

846993f796

docs: red team intro (#1662)

11 months ago

final-prompt-for-test-case.png

a3b36db1c0

site: landing page updates (#1096)

1 year ago

gemma-vs-llama.png

a3b36db1c0

site: landing page updates (#1096)

1 year ago

gemma-vs-mistral-examples.png

a3b36db1c0

site: landing page updates (#1096)

1 year ago

gemma-vs-mistral.png

a3b36db1c0

site: landing page updates (#1096)

1 year ago

github-action-comment.png

a3b36db1c0

site: landing page updates (#1096)

1 year ago

github-action-comment@2x.png

a3b36db1c0

site: landing page updates (#1096)

1 year ago

github-action-redteam.png

9ab1445567

docs: add red team github action info (#5294)

5 days ago

goat-attack-flow.svg

b9c0fc86c2

docs: fix image height

9 months ago

goat.svg

9a1b13d1e4

docs: update goat diagram

9 months ago

gpt-3.5-vs-gpt-4.png

a3b36db1c0

site: landing page updates (#1096)

1 year ago

gpt-4.1-vs-gpt-4o-mmlu-results.png

a39b48847a

docs(guides): add GPT-4.1 vs GPT-4o MMLU comparison guide (#4399)

2 months ago

gpt-4.1-vs-gpt-4o-mmlu.png

a39b48847a

docs(guides): add GPT-4.1 vs GPT-4o MMLU comparison guide (#4399)

2 months ago

gpt-4o-mini-vs-gpt-4o.png

b6b2dedcef

site: enterprise blog post (#1497)

1 year ago

gpt-4o-vs-gpt-4o-mini.png

8225d16ccb

docs: add guide for comparing GPT-4o vs GPT-4o-mini (#1200)

1 year ago

gpt-temperature-hallucination.png

4ee94c8b68

docs: Add guide for temperature comparison

1 year ago

hallucination-example-1.png

a3b36db1c0

site: landing page updates (#1096)

1 year ago

hallucination-example-2.png

a3b36db1c0

site: landing page updates (#1096)

1 year ago

harmbench-results.png

e42c4b953d

feat(redteam): Add a plugin to run redteams against the HarmBench dataset (#2896)

6 months ago

huggingface-create-endpoint.png

a3b36db1c0

site: landing page updates (#1096)

1 year ago

huggingface-inference-endpoint.png

a3b36db1c0

site: landing page updates (#1096)

1 year ago

interactive-providers.png

a3b36db1c0

site: landing page updates (#1096)

1 year ago

iterative-jailbreak-diagram.svg

88be44d791

docs: iterative jailbreak diagram (#4191)

2 months ago

langchain-eval.png

a3b36db1c0

site: landing page updates (#1096)

1 year ago

llama-gpt-comparison.png

23e57def26

chore: update llama examples and add support for chat formatted prompts in Replicate (#1261)

1 year ago

llama-uncensored-comparison-details.png

e1aa6ab106

docs: Merge docs into main repo (#317)

1 year ago

llama-uncensored-comparison.png

a3b36db1c0

site: landing page updates (#1096)

1 year ago

llm-temperature-comparison-webview.png

a3b36db1c0

site: landing page updates (#1096)

1 year ago

llm-testing-diagram.svg

0cb88e726e

docs: red team intro updates

11 months ago

llm-vulnerability-types.svg

6d0e6b1332

docs: add vuln types diagram

7 months ago

mistral-llama2-comparison.png

a3b36db1c0

site: landing page updates (#1096)

1 year ago

mistral-magistral-aime2024-evaluation-results.png

acd51ac2bc

feat(providers): add Mistral Magistral reasoning models (#4435)

2 months ago

mistral-vs-mixtral-vs-llama.png

a3b36db1c0

site: landing page updates (#1096)

1 year ago

mixtral-vs-gpt.png

a3b36db1c0

site: landing page updates (#1096)

1 year ago

multi-turn-jailbreak.svg

7f7dc6e5be

docs: add jailbreak images

1 year ago

named-metrics.png

a3b36db1c0

site: landing page updates (#1096)

1 year ago

o1-vs-gpt.png

b9aa6ec29b

docs: gpt vs o1 guide (#1703)

11 months ago

openai-vs-azure-comparison.png

a3b36db1c0

site: landing page updates (#1096)

1 year ago

owasp-genai-red-team-preset.png

01f421a137

docs: add screenshot (#3582)

4 months ago

owasp-llm-top10.svg

6e259812e2

docs: fix diagram

7 months ago

owasp-selection.png

e654e5a64c

docs: add owasp selection image (#3696)

4 months ago

phi-vs-llama.png

a3b36db1c0

site: landing page updates (#1096)

1 year ago

plugin-flow.svg

5b91ad8804

docs: plugin and strategy graphics (#2610)

7 months ago

prompt-injection-example.png

846993f796

docs: red team intro (#1662)

11 months ago

qwen-eval-webui.png

a3b36db1c0

site: landing page updates (#1096)

1 year ago

qwen-eval.png

a3b36db1c0

site: landing page updates (#1096)

1 year ago

rag-eval-compare-models.png

a3b36db1c0

site: landing page updates (#1096)

1 year ago

rag-eval-multiple-prompts.png

a3b36db1c0

site: landing page updates (#1096)

1 year ago

rag-eval-view-test-details.gif

e1aa6ab106

docs: Merge docs into main repo (#317)

1 year ago

rag-poisoning-example.svg

655e268dc4

feat: rag poisoning (#2078)

9 months ago

rag-poisoning.svg

655e268dc4

feat: rag poisoning (#2078)

9 months ago

red-team-basic-architecture.png

f9fee9ea94

docs: basic enterprise arch diagram (#3988)

3 months ago

redteam-results.png

a3b36db1c0

site: landing page updates (#1096)

1 year ago

redteam-run.png

f9977b026a

docs: misc improvements (#2525)

7 months ago

replicate-lifeboat-comparison.png

a3b36db1c0

site: landing page updates (#1096)

1 year ago

strategy-flow.svg

5b91ad8804

docs: plugin and strategy graphics (#2610)

7 months ago

text-to-sql-eval.png

a3b36db1c0

site: landing page updates (#1096)

1 year ago

trace.png

6c51a9456f

feat: opentelemetry tracing support (#4600)

2 months ago

training-data-leakage.png

846993f796

docs: red team intro (#1662)

11 months ago

training-data-leakage2.png

846993f796

docs: red team intro (#1662)

11 months ago

tree-jailbreak.svg

7f7dc6e5be

docs: add jailbreak images

1 year ago

vector-db-comparison.png

a3b36db1c0

site: landing page updates (#1096)

1 year ago

vertex-vs-gpt-cli.png

a3b36db1c0

site: landing page updates (#1096)

1 year ago

vertex-vs-gpt.png

a3b36db1c0

site: landing page updates (#1096)

1 year ago

Comments

Use AWS S3 as storage!

Specify your S3 bucket

Access key (If needed)

Congratulations!

Use Google Cloud Storage!

Specify your Google Storage bucket

Service Account Key

Congratulations!

Use Azure Cloud Storage!

Specify your Azure Storage bucket

Access key (If needed)

Congratulations!

Use any S3 compatible storage!

Specify your S3 bucket

Access key (If needed)

Congratulations!

nirbarazida / promptfoo mirror of https://github.com/promptfoo/promptfoo

Comments

Use AWS S3 as storage!

Specify your S3 bucket

Access key (If needed)

Congratulations!

Use Google Cloud Storage!

Specify your Google Storage bucket

Service Account Key

Congratulations!

Use Azure Cloud Storage!

Specify your Azure Storage bucket

Access key (If needed)

Congratulations!

Use any S3 compatible storage!

Specify your S3 bucket

Access key (If needed)

Congratulations!

nirbarazida
/
promptfoo
mirror of https://github.com/promptfoo/promptfoo