Register
Login
Resources
Docs Blog Datasets Glossary Case Studies Tutorials & Webinars
Product
Data Engine LLMs Platform Enterprise
Pricing Explore
Connect to our Discord channel

promptfooconfig.yaml 863 B

You have to be logged in to leave a comment. Sign In
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
  1. prompts:
  2. - file://prompt*.txt
  3. providers:
  4. - openai:gpt-4o-mini
  5. # The defaultTest configuration is applied to every test case in this config.
  6. defaultTest:
  7. vars:
  8. system_message: file://system_prompt.txt
  9. # Loads & runs all test cases matching these filepaths
  10. tests:
  11. # You can supply an exact filepath
  12. - file://tests/tests2.yaml
  13. # Or a glob (wildcard)
  14. - file://tests/*
  15. # Mix and match with actual test cases
  16. - vars:
  17. topic: the internet
  18. content_type: witty tweets
  19. # Use the file:// prefix to load entire files as vars
  20. - vars:
  21. topic: file://vars/var_topic.yaml
  22. content_type: file://vars/var_content_type.yaml
  23. # You can also use the file:// prefix to load assertions
  24. - vars:
  25. topic: fruit loops
  26. content_type: Youtube intro
  27. assert:
  28. - type: javascript
  29. value: file://asserts/assert.js
Tip!

Press p or to see the previous file or, n or to see the next file

Comments

Loading...