Connect to our Discord channel
| sidebar_label |
|---|
| Manual Input |
The Manual Input Provider allows you to manually enter responses for each prompt during the evaluation process. This can be useful for testing, debugging, or when you want to provide custom responses without relying on an automated API.
To use the provider, set the provider id to promptfoo:manual-input in your configuration file:
Models
Annotations
providers:
- promptfoo:manual-input
By default, the provider will prompt the user on the CLI for a single line of output. To open an editor that supports multiline input:
providers:
- id: promptfoo:manual-input
config:
multiline: true
To make manual input easier on the command line, set concurrency to 1 and disable progress bars:
promptfoo eval -j 1 --no-progress-bar
Press p or to see the previous file or, n or to see the next file
Browsing data directories saved to S3 is possible with DAGsHub. Let's configure your repository to easily display your data in the context of any commit!
promptfoo is now integrated with AWS S3!
Are you sure you want to delete this access key?
Browsing data directories saved to Google Cloud Storage is possible with DAGsHub. Let's configure your repository to easily display your data in the context of any commit!
promptfoo is now integrated with Google Cloud Storage!
Are you sure you want to delete this access key?
Browsing data directories saved to Azure Cloud Storage is possible with DAGsHub. Let's configure your repository to easily display your data in the context of any commit!
promptfoo is now integrated with Azure Cloud Storage!
Are you sure you want to delete this access key?
Browsing data directories saved to S3 compatible storage is possible with DAGsHub. Let's configure your repository to easily display your data in the context of any commit!
promptfoo is now integrated with your S3 compatible storage!
Are you sure you want to delete this access key?