promptfoo/examples/csv-metadata

CSV Metadata Example

This example demonstrates how to use metadata columns in CSV test files to organize and filter your test cases. You can see more details on how to build a test cases CSV in the Promptfoo docs

Files

• promptfooconfig.yaml: Configuration file with a simple prompt and provider setup
• tests.csv: Test cases with metadata columns for categorization and filtering

Metadata Columns

The CSV file includes two types of metadata columns:

1. __metadata:category - Single value metadata for broad categorization
2. __metadata:tags[] - Array metadata for multiple tags, with comma separation and escape support

Running the Example

Basic evaluation:

promptfoo eval

Filter by category:

promptfoo eval --filter-metadata category=technology

Filter by tags:

promptfoo eval --filter-metadata tags=ai

Note that array metadata values (tags) support escaped commas. For example, "global,warming" is treated as a single tag.

Expected Output

The example includes basic assertions using the __expected column to verify outputs contain relevant keywords.