Register
Login
Resources
Docs Blog Datasets Glossary Case Studies Tutorials & Webinars
Product
Data Engine LLMs Platform Enterprise
Pricing Explore
Connect to our Discord channel

promptfooconfig.yaml 895 B

You have to be logged in to leave a comment. Sign In
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
  1. # yaml-language-server: $schema=https://promptfoo.dev/config-schema.json
  2. description: Azure OpenAI chat and embeddings with fact generation
  3. prompts:
  4. - 'Generate one very interesting fact about {{topic}}'
  5. providers:
  6. - id: azure:chat:gpt-4o-deployment1
  7. config:
  8. apiHost: 'your-org.openai.azure.com'
  9. # Example of reasoning model setup
  10. - id: azure:chat:o3-mini-deployment
  11. config:
  12. apiHost: 'your-org.openai.azure.com'
  13. # Flag to indicate this is a reasoning model (o1, o3-mini, etc.)
  14. isReasoningModel: true
  15. defaultTest:
  16. assert:
  17. - type: latency
  18. threshold: 3000
  19. tests:
  20. - vars:
  21. topic: monkeys
  22. - vars:
  23. topic: bananas
  24. assert:
  25. - type: similar
  26. value: Bananas are naturally radioactive.
  27. provider:
  28. id: azure:embeddings:ada-deployment1
  29. config:
  30. apiHost: 'your-org.openai.azure.com'
Tip!

Press p or to see the previous file or, n or to see the next file

Comments

Loading...