nirbarazida/promptfoo

Michael bf72c1d6e7

test: stabilize redteam index tests

2 months ago

Commits

__mocks__

81122a40cd

test: improve type safety and resolve TypeScript errors (#1216)

1 year ago

assertions

d7383bb6ee

feat(providers): add OpenAI MCP (Model Context Protocol) support to Responses API (#4180)

3 months ago

commands

b6907ea8e8

fix(eval): handle undefined maxConcurrency with proper fallbacks (#4314)

2 months ago

factories

e351003869

feat: Server-side pagination, filtering and search for eval results table (#4054)

3 months ago

globalConfig

a4659f4b4c

test: add unit test for src/globalConfig/accounts.ts (#4259)

2 months ago

integrations

52a3be994a

test: fix huggingface dataset tests to mock environment variables (#3936)

3 months ago

models

e351003869

feat: Server-side pagination, filtering and search for eval results table (#4054)

3 months ago

prompts

c4c6021f7c

test: improve test setup and teardown for better isolation (#4331)

2 months ago

providers

c4c6021f7c

test: improve test setup and teardown for better isolation (#4331)

2 months ago

python

7d08a25592

test: add unit test for src/python/pythonUtils.ts (#3915)

3 months ago

redteam

bf72c1d6e7

test: stabilize redteam index tests

2 months ago

server

364a456df6

chore(webui): add max concurrency as an option for run in browser (#4147)

3 months ago

site

f90fe98182

chore: remove redundant test comments (#4183)

3 months ago

testCase

a1caaebcb6

refactor: split test case loading from synthesis (#3004)

6 months ago

types

3e264556ab

refactor(tests): consolidate and reorganize test files (#3616)

4 months ago

util

c4c6021f7c

test: improve test setup and teardown for better isolation (#4331)

2 months ago

validators

18475f2451

chore(redteam): add severity levels to redteam plugin objects (#4310)

2 months ago

account.test.ts

72e84c04b3

chore: revert telemtry changes (#4122)

3 months ago

cache.test.ts

47b4f15856

chore: expose `deleteFromCache` to evict cache keys after fetch by providers (#3009)

6 months ago

checkNodeVersion.test.ts

6b486a3954

test: configure default globalConfig mock and logger mock (#2915)

6 months ago

constants.test.ts

9cee0b8160

build: add Node.js 24 support (#3941)

3 months ago

csv.test.ts

b96c7e0f61

feat: google valid function call (#3605)

4 months ago

envars.test.ts

92d22c3019

feat: add PROMPTFOO_DISABLE_OBJECT_STRINGIFY environment variable for object template handling (#4297)

2 months ago

esm.test.ts

361e8b6e56

fix: broken handling of absolute paths in hook/code import (#3060)

6 months ago

evaluator.test.ts

63c35b51b0

fix: file content not being loaded when referenced with file:// prefix in vars (#3793)

2 months ago

evaluatorHelpers.test.ts

fec69139c6

feat: Display audio file variables in result table (#3864)

2 months ago

feedback.test.ts

5dfa39ca8e

refactor: centralize readline utilities to fix Jest open handle issues (#4219)

3 months ago

fetch.test.ts

ff987fc25e

fix(fetch): respect NO_PROXY env var with HTTPS_PROXY (#3962)

3 months ago

globalConfig.test.ts

72e84c04b3

chore: revert telemtry changes (#4122)

3 months ago

googleSheets.test.ts

2ecfd1a110

chore: update Google Sheets fetch to use proxy helper (#4087)

3 months ago

guardrails.test.ts

a08fc4e4da

feat(eval): track assertion tokens in token usage (#3551)

4 months ago

index.test.ts

7328eeed43

fix: resolve model-graded assertion providers from providerMap (#4111) (#4273)

2 months ago

logger.test.ts

7f6ffe53ec

fix(logger): fix `[Object object]` empty string error (#3638)

4 months ago

main.test.ts

131c36dd4c

chore: add global env-file option to all commands recursively (#3969)

3 months ago

matchers.test.ts

92d22c3019

feat: add PROMPTFOO_DISABLE_OBJECT_STRINGIFY environment variable for object template handling (#4297)

2 months ago

onboarding.test.ts

72e84c04b3

chore: revert telemtry changes (#4122)

3 months ago

providers.test.ts

bbbeb35f01

chore(providers): update default openai models for openai:chat alias (#4066)

3 months ago

rateLimit.test.ts

8494c43824

chore: replace node-fetch with native fetch API (#1968)

10 months ago

sagemaker.test.ts

fcf6ac48f9

feat(providers): add support for Amazon SageMaker (#3413)

5 months ago

share.test.ts

ab386ad410

fix: need to send auth request to api path (#4199)

3 months ago

table.test.ts

a938e4b52c

feat: optionally time out eval steps (#3765)

3 months ago

telemetry.test.ts

33b075d5ec

chore(telemetry): add isRedteam property to telemetry events (#4149)

3 months ago

updates.test.ts

6b486a3954

test: configure default globalConfig mock and logger mock (#2915)

6 months ago

Comments

Use AWS S3 as storage!

Specify your S3 bucket

Access key (If needed)

Congratulations!

Use Google Cloud Storage!

Specify your Google Storage bucket

Service Account Key

Congratulations!

Use Azure Cloud Storage!

Specify your Azure Storage bucket

Access key (If needed)

Congratulations!

Use any S3 compatible storage!

Specify your S3 bucket

Access key (If needed)

Congratulations!

nirbarazida / promptfoo mirror of https://github.com/promptfoo/promptfoo

Comments

Use AWS S3 as storage!

Specify your S3 bucket

Access key (If needed)

Congratulations!

Use Google Cloud Storage!

Specify your Google Storage bucket

Service Account Key

Congratulations!

Use Azure Cloud Storage!

Specify your Azure Storage bucket

Access key (If needed)

Congratulations!

Use any S3 compatible storage!

Specify your S3 bucket

Access key (If needed)

Congratulations!

nirbarazida
/
promptfoo
mirror of https://github.com/promptfoo/promptfoo