nirbarazida/promptfoo

Ian Webster 6d4732f8eb

docs: add `label` to python provider example

2 weeks ago

Commits

amazon-bedrock

3014f7ebf0

chore: formatting

1 month ago

assistant-cli

95072d7abf

chore: prefer yaml array syntax in examples

5 months ago

azure-openai

96c6af17c9

feat: add logprobs support for azure openai (#376)

4 months ago

azure-openai-assistant

3014f7ebf0

chore: formatting

1 month ago

claude-vision

b71fdc2bb6

feat: Support claude vision and images (#639)

1 month ago

claude-vs-gpt

9c44f4763c

docs: add claude and dbrx examples

1 month ago

cohere

3014f7ebf0

chore: formatting

1 month ago

cohere-benchmark

d1eeab9f33

docs: add cohere benchmark

1 month ago

colab-notebook

a8717883a1

updated node version update of Google Colab notebook (#171)

7 months ago

custom-grading-prompt

3996ce0e71

Improvements to custom grading (#140)

8 months ago

custom-prompt-function

3014f7ebf0

chore: formatting

1 month ago

custom-provider

3014f7ebf0

chore: formatting

1 month ago

custom-provider-embeddings

3014f7ebf0

chore: formatting

1 month ago

dalle-images

3014f7ebf0

chore: formatting

1 month ago

dbrx-benchmark

3b791dc300

feat: first-class support for openrouter (#702)

3 weeks ago

dynamic-var

3014f7ebf0

chore: formatting

1 month ago

external-provider-config

67d4e7e677

feat: Add support for external provider configs via file:// (#296)

5 months ago

gemma-vs-llama

3014f7ebf0

chore: formatting

1 month ago

gemma-vs-mistral

3014f7ebf0

chore: formatting

1 month ago

github-action

eb9472b8d5

Add example standalone github action

7 months ago

google-aistudio-gemini

3014f7ebf0

chore: formatting

1 month ago

google-sheets

79058e4140

feat: ability to write outputs to google sheet (#701)

3 weeks ago

google-vertex

7beb7df18b

fix(vertex): display api errors

1 month ago

gpt-3.5-temperature-comparison

5efb6fea1b

feat: add label field to provider options (#563)

1 month ago

gpt-3.5-vs-4

3014f7ebf0

chore: formatting

1 month ago

groq

3014f7ebf0

chore: formatting

1 month ago

huggingface-hate-speech-detection

b0bc0984ee

feat(huggingface): Support sentence similarity inference API (#425)

3 months ago

huggingface-inference-endpoint

3014f7ebf0

chore: formatting

1 month ago

huggingface-pii

3014f7ebf0

chore: formatting

1 month ago

huggingface-similarity

3014f7ebf0

chore: formatting

1 month ago

ibm-granite-vs-llama

d6ae65e75d

feat: Support IBM Research BAM provider (#711)

2 weeks ago

jest-integration

2a3a1da67b

chore: update jest integration example with new filepaths

1 month ago

js-config

bf81260b44

Simplify API and add support for unified test suite definition (#14)

11 months ago

json-output

3014f7ebf0

chore: formatting

1 month ago

langchain-python

d33dea1032

chore: bump langchain version in langchain example

1 month ago

llama-gpt-comparison

1e45721eb3

docs: update llama-gpt-comparison example

3 weeks ago

mistral-llama-comparison

3014f7ebf0

chore: formatting

1 month ago

multiple-configs

3014f7ebf0

chore: formatting

1 month ago

multiple-translations

5f25ab91fe

feat: ability to import vars using glob (#641)

1 month ago

multiple-translations-scenarios

95072d7abf

chore: prefer yaml array syntax in examples

5 months ago

multiple-turn-conversation

5480efa410

Add _conversation variable for testing multiple-turn chat conversations (#224)

7 months ago

multishot

1e2c3205d8

formatting

11 months ago

named-metrics

a54deef5a3

docs: document named metrics

5 months ago

node-package

9e4569be68

docs: fix header indentation

1 month ago

nunjucks-custom-filters

788a6b82e6

Add support for nunjucks filters (#243)

6 months ago

ollama-comparison

3014f7ebf0

chore: formatting

1 month ago

openai-chat-history

9c103978dc

docs: example of escaping multiline var in nunjucks template

1 month ago

openai-eval-factuality

bb342e5d99

fix(factuality): make factuality output case-insensitive (#468)

3 months ago

openai-function-call

3fe0af6f55

fix: openai tools and function checks handle plaintext responses (#541)

2 months ago

openai-multiline-yaml

7e4a1f770d

yaml formatting

10 months ago

openai-tools-call

3fe0af6f55

fix: openai tools and function checks handle plaintext responses (#541)

2 months ago

openai-vision

d6a703a2bc

docs: Add documentation for openai vision (#637)

1 month ago

perplexity.ai-example

3014f7ebf0

chore: formatting

1 month ago

portkey-test

6419267d42

feat: portkey.ai integration (#698)

3 weeks ago

python-assert-external

c73c8d90a0

fix: include detail from external python assertion (#691)

3 weeks ago

python-assert-inline

3014f7ebf0

chore: formatting

1 month ago

python-provider

6d4732f8eb

docs: add `label` to python provider example

2 weeks ago

rag-eval

d2ba1e4111

docs: rag-eval example and assertion types

6 months ago

replicate-lifeboat

e39d761cb5

chore: format

5 months ago

replicate-llama2

770e36370d

fix(replicate): support non-array outputs (#547)

2 months ago

select-best-example

3014f7ebf0

chore: formatting

1 month ago

self-grading

95072d7abf

chore: prefer yaml array syntax in examples

5 months ago

separate-test-configs

95072d7abf

chore: prefer yaml array syntax in examples

5 months ago

simple-cli

3014f7ebf0

chore: formatting

1 month ago

simple-csv

95072d7abf

chore: prefer yaml array syntax in examples

5 months ago

simple-test

ae35d26c44

feat: update CSV and HTML outputs with more details (#393)

4 months ago

standalone-assertions

3014f7ebf0

chore: formatting

1 month ago

summarization

96cd07474e

docs: summarization example

2 weeks ago

transform-file

3014f7ebf0

chore: formatting

1 month ago

vars-referencing-vars

3014f7ebf0

chore: formatting

1 month ago

Comments

Use Google Cloud Storage!

Specify your Google Storage bucket

Service Account Key

Congratulations!

Use AWS S3 as storage!

Specify your S3 bucket

Access key (If needed)

Congratulations!

Use any S3 compatible storage!

Specify your S3 bucket

Access key (If needed)

Congratulations!

Use Azure Cloud Storage!

Specify your Azure Storage bucket

Access key (If needed)

Congratulations!

nirbarazida / promptfoo mirror of https://github.com/promptfoo/promptfoo

Comments

Use Google Cloud Storage!

Specify your Google Storage bucket

Service Account Key

Congratulations!

Use AWS S3 as storage!

Specify your S3 bucket

Access key (If needed)

Congratulations!

Use any S3 compatible storage!

Specify your S3 bucket

Access key (If needed)

Congratulations!

Use Azure Cloud Storage!

Specify your Azure Storage bucket

Access key (If needed)

Congratulations!

nirbarazida
/
promptfoo
mirror of https://github.com/promptfoo/promptfoo