promptfoo/examples/assertion-scoring-override/README.md

assertion-scoring-override (Assertion Scoring Function Override Example)

You can run this example with:

npx promptfoo@latest init --example assertion-scoring-override

This example demonstrates different ways to define and override the default scoring function in promptfoo. It shows three patterns for implementing and referencing scoring functions:

1. A global override in the defaultTest section of the config
2. A named export in a JavaScript file
3. A Python function export in a Python file

Getting Started

Initialize the example:

npx promptfoo@latest init --example assertion-scoring-override

Run the evaluation:

cd assertion-scoring-override
promptfoo eval

View the results:

promptfoo view