promptfoo/examples/csv-metadata

csv-metadata (# CSV Metadata Example)

You can run this example with:

npx promptfoo@latest init --example csv-metadata

This example demonstrates how to use metadata columns in CSV test files to organize and filter your test cases. You can see more details on how to build a test cases CSV in the Promptfoo docs

Files

• promptfooconfig.yaml: Configuration file with a simple prompt and provider setup
• tests.csv: Test cases with metadata columns for categorization and filtering

Metadata Columns

The CSV file includes two types of metadata columns:

1. __metadata:category - Single value metadata for broad categorization
2. __metadata:tags[] - Array metadata for multiple tags, with comma separation and escape support

Running the Example

Basic evaluation:

promptfoo eval

Filter by category:

promptfoo eval --filter-metadata category=technology

Filter by tags:

promptfoo eval --filter-metadata tags=ai

Note that array metadata values (tags) support escaped commas. For example, "global,warming" is treated as a single tag.

Expected Output

The example includes basic assertions using the __expected column to verify outputs contain relevant keywords.