nirbarazida/promptfoo

Faizan Minhas 58fd112507

chore: integrate knip for unused code detection and clean up codebase (#4464)

1 month ago

Commits

anthropic

183754ccb7

feat(assertion): add finish reason as assertion option (#3879)

1 month ago

azure

58fd112507

chore: integrate knip for unused code detection and clean up codebase (#4464)

1 month ago

bedrock

64ff16b7ec

feat: add contextTransform support for RAG evaluation (#4467)

1 month ago

google

a0d2d07630

chore: update experimental Gemini model IDs to stable versions (#4894)

1 month ago

hyperbolic

56b1ae2b08

test: fix hyperbolic provider tests failing due to env variable pollution (#4619)

2 months ago

mcp

cc7b82b84b

fix: Failing test (#4829)

1 month ago

openai

183754ccb7

feat(assertion): add finish reason as assertion option (#3879)

1 month ago

xai

c97a6d8812

feat(providers): add grok-4 support (#4855)

1 month ago

adaline.gateway.test.ts

915354b3a8

refactor(providers): structural refactor of google provider (#3548)

4 months ago

ai21.test.ts

425e2fa7ca

test: isolate mocks so tests can run in any order with --randomize (#4744)

1 month ago

aimlapi.test.ts

2ef2f5bde9

feat(providers): Add new AIMLAPI provider (#4721)

1 month ago

alibaba.test.ts

2175f2a5fa

chore(providers): allow Alibaba API base URL override (#3040)

6 months ago

azure.test.ts

abaf4fa347

chore(providers): Improve guardrails handling in Azure providers (#4788)

1 month ago

bam.test.ts

c5fe747d64

test: add unit test for src/providers/bam.ts (#2748)

7 months ago

browser.test.ts

b5f0766391

chore(deps): update minor and patch dependencies (#4686)

1 month ago

cerebras.test.ts

3727ff5c37

feat(providers): add cerebras provider (#3814)

4 months ago

cloudflare-ai.test.ts

cbe7d1f9ac

chore(providers): convert Cloudflare AI to use OpenAI-compatible endpoints (#4683)

1 month ago

databricks.test.ts

3cdff2b898

docs(providers): update available databricks models (#4887)

1 month ago

defaults.test.ts

acd51ac2bc

feat(providers): add Mistral Magistral reasoning models (#4435)

2 months ago

echo.test.ts

35cc7b79a4

chore(providers): support entire ProviderResponse output (#3343)

5 months ago

fal.test.ts

5e3223a2cb

chore(providers): update fal provider (#4182)

3 months ago

golangCompletion.test.ts

cdd69303d1

test: improve mock setup and teardown for --randomize (#4569)

2 months ago

groq.test.ts

3339a224d7

chore(providers): migrate Groq to use OpenAI provider - add groq reasoning example (#2952)

6 months ago

helicone.test.ts

43f6a9302e

feat(providers): add Helicone AI Gateway provider (#4662)

1 month ago

http.test.ts

a2310631d4

fix: the case when http body has not escaped charactors (#4739)

1 month ago

hyperbolic.test.ts

1b0e8b4c87

feat(providers): add support for hyperbolic image and audio providers (#4260)

2 months ago

index.test.ts

5cfe9d6ea3

chore: migrate from ESLint + Prettier to Biome (#4903)

1 month ago

lambdalabs.test.ts

598e71c089

feat(providers): add Lambda Labs integration (#3601)

4 months ago

litellm.test.ts

b74d3e954b

feat(providers): add embedding support to LiteLLM provider (#4804)

1 month ago

llama.test.ts

ff3b4f6575

fix: better openai rate limit handling (#1981)

10 months ago

mistral.test.ts

acd51ac2bc

feat(providers): add Mistral Magistral reasoning models (#4435)

2 months ago

ollama.test.ts

02e4077bd4

test: add unit test for src/providers/ollama.ts (#4509)

2 months ago

packageParser.test.ts

6b486a3954

test: configure default globalConfig mock and logger mock (#2915)

6 months ago

perplexity.test.ts

1100ed924f

chore(providers): improve Perplexity API integration (#3990)

3 months ago

portkey.test.ts

1d9b81c82d

test: add unit test for src/providers/portkey.ts (#2825)

7 months ago

promptfoo.test.ts

20b0dbd2e2

feat(redteam): add mischievous user strategy (#4107)

1 month ago

promptfooModel.test.ts

fc269b66eb

feat: promptfoo model endpoint (#3534)

4 months ago

pythonCompletion.fileRef.test.ts

8b2b1bfe7f

feat(providers): load arbitrary files in nested configs in python provider (#3540)

4 months ago

pythonCompletion.test.ts

8b2b1bfe7f

feat(providers): load arbitrary files in nested configs in python provider (#3540)

4 months ago

registry.test.ts

20b0dbd2e2

feat(redteam): add mischievous user strategy (#4107)

1 month ago

replicate.test.ts

6d4ea226bc

chore: update replicate default moderation provider (#3097)

6 months ago

scriptBasedProvider.test.ts

ab78796334

fix: Resolve paths relative to promptfooconfig when not cloud config (#4001)

3 months ago

scriptCompletion.test.ts

cdd69303d1

test: improve mock setup and teardown for --randomize (#4569)

2 months ago

shared.test.ts

1e7ccd087a

fix: Telemetry for redteams (#4641)

2 months ago

simulatedUser.test.ts

20b0dbd2e2

feat(redteam): add mischievous user strategy (#4107)

1 month ago

togetherai.test.ts

29b6a5ff01

fix(togetherai): ensure max_tokens is respected in configuration (#3468)

5 months ago

watsonx.test.ts

425e2fa7ca

test: isolate mocks so tests can run in any order with --randomize (#4744)

1 month ago

webhook.test.ts

6b486a3954

test: configure default globalConfig mock and logger mock (#2915)

6 months ago

websocket.test.ts

09c31a91c1

feat(providers): websocket header support (#4456)

2 months ago

Comments

Use AWS S3 as storage!

Specify your S3 bucket

Access key (If needed)

Congratulations!

Use Google Cloud Storage!

Specify your Google Storage bucket

Service Account Key

Congratulations!

Use Azure Cloud Storage!

Specify your Azure Storage bucket

Access key (If needed)

Congratulations!

Use any S3 compatible storage!

Specify your S3 bucket

Access key (If needed)

Congratulations!

nirbarazida / promptfoo mirror of https://github.com/promptfoo/promptfoo

Comments

Use AWS S3 as storage!

Specify your S3 bucket

Access key (If needed)

Congratulations!

Use Google Cloud Storage!

Specify your Google Storage bucket

Service Account Key

Congratulations!

Use Azure Cloud Storage!

Specify your Azure Storage bucket

Access key (If needed)

Congratulations!

Use any S3 compatible storage!

Specify your S3 bucket

Access key (If needed)

Congratulations!

nirbarazida
/
promptfoo
mirror of https://github.com/promptfoo/promptfoo