promptfoo/examples/databricks

databricks

Test Databricks Foundation Model APIs with promptfoo.

Getting Started

You can run this example with:

npx promptfoo@latest init --example databricks

Prerequisites

1. A Databricks workspace with Foundation Model APIs enabled
2. A Databricks access token

Environment Variables

This example requires the following environment variables:

• DATABRICKS_WORKSPACE_URL - Your Databricks workspace URL (e.g., https://your-workspace.cloud.databricks.com)
• DATABRICKS_TOKEN - Your Databricks access token

You can set these in a .env file or directly in your environment:

export DATABRICKS_WORKSPACE_URL=https://your-workspace.cloud.databricks.com
export DATABRICKS_TOKEN=your-databricks-token

Running the Example

# Run the evaluation
npx promptfoo@latest eval

# View results in the web UI
npx promptfoo@latest view

What This Example Demonstrates

• Using Databricks pay-per-token endpoints (Foundation Models)
• Basic text generation with Llama 3.3
• Cost tracking with usage context
• Simple assertions and quality checks

Vision Models

For vision capabilities, use the dedicated configuration:

npx promptfoo@latest eval -c promptfooconfig.vision.yaml

Learn More

• Databricks Foundation Model APIs
• promptfoo Databricks provider documentation