nirbarazida/promptfoo

Michael e95800fcde

chore(telemetry): add isRunningInCi flag to telemetry events (#4115)

3 months ago

Commits

__mocks__

81122a40cd

test: improve type safety and resolve TypeScript errors (#1216)

1 year ago

assertions

0970efdd03

chore: add vision grading example (#4090)

3 months ago

commands

03115be59e

chore: Improve memory usage when sharing results (#4050)

3 months ago

factories

06e38a4469

chore(cli/redteam/run): Default to outputting generated Redteam config in same dir as input config (#3721)

4 months ago

globalConfig

b50f917861

chore: Better error messages on cloud requests (#3934)

3 months ago

integrations

52a3be994a

test: fix huggingface dataset tests to mock environment variables (#3936)

3 months ago

models

4a97588b13

test: add unit test for src/models/eval.ts (#3904)

3 months ago

prompts

7167a78574

chore: update telemetry endpoint (#3751)

4 months ago

providers

0624ae573a

chore(providers): support templated URLs in http (#4103)

3 months ago

python

7d08a25592

test: add unit test for src/python/pythonUtils.ts (#3915)

3 months ago

redteam

c8acbd9487

fix(plugins): Skip plugins when validation fails (#4101)

3 months ago

server

fa9822e2d3

test: add unit test for src/server/server.ts (#3198)

6 months ago

testCase

a1caaebcb6

refactor: split test case loading from synthesis (#3004)

6 months ago

types

3e264556ab

refactor(tests): consolidate and reorganize test files (#3616)

4 months ago

util

3e1d04414e

chore(eval): Add evaluation duration display (#3996)

3 months ago

account.test.ts

7167a78574

chore: update telemetry endpoint (#3751)

4 months ago

cache.test.ts

47b4f15856

chore: expose `deleteFromCache` to evict cache keys after fetch by providers (#3009)

6 months ago

checkNodeVersion.test.ts

6b486a3954

test: configure default globalConfig mock and logger mock (#2915)

6 months ago

constants.test.ts

9cee0b8160

build: add Node.js 24 support (#3941)

3 months ago

csv.test.ts

b96c7e0f61

feat: google valid function call (#3605)

4 months ago

envars.test.ts

26f937bd87

feat(env): allow every env variable to be overridden within the env block in a promptfoo config (#3786)

4 months ago

esm.test.ts

361e8b6e56

fix: broken handling of absolute paths in hook/code import (#3060)

6 months ago

evaluator.test.ts

03115be59e

chore: Improve memory usage when sharing results (#4050)

3 months ago

evaluatorHelpers.test.ts

d38df37f7f

test: add unit test for src/evaluatorHelpers.ts (#4037)

3 months ago

feedback.test.ts

cd8c5726a1

chore: improve readline handling and tests (#3763)

4 months ago

fetch.test.ts

ff987fc25e

fix(fetch): respect NO_PROXY env var with HTTPS_PROXY (#3962)

3 months ago

globalConfig.test.ts

f2a22e6c55

fix(cli): Read `.env` file prior to calling env var getters (#3892)

3 months ago

googleSheets.test.ts

2ecfd1a110

chore: update Google Sheets fetch to use proxy helper (#4087)

3 months ago

guardrails.test.ts

a08fc4e4da

feat(eval): track assertion tokens in token usage (#3551)

4 months ago

index.test.ts

a08fc4e4da

feat(eval): track assertion tokens in token usage (#3551)

4 months ago

logger.test.ts

7f6ffe53ec

fix(logger): fix `[Object object]` empty string error (#3638)

4 months ago

main.test.ts

131c36dd4c

chore: add global env-file option to all commands recursively (#3969)

3 months ago

matchers.test.ts

0970efdd03

chore: add vision grading example (#4090)

3 months ago

onboarding.test.ts

26f937bd87

feat(env): allow every env variable to be overridden within the env block in a promptfoo config (#3786)

4 months ago

providers.test.ts

bbbeb35f01

chore(providers): update default openai models for openai:chat alias (#4066)

3 months ago

rateLimit.test.ts

8494c43824

chore: replace node-fetch with native fetch API (#1968)

10 months ago

sagemaker.test.ts

fcf6ac48f9

feat(providers): add support for Amazon SageMaker (#3413)

5 months ago

share.test.ts

64e0843e0e

chore: Remove deprecated sharing setups (#4082)

3 months ago

table.test.ts

a938e4b52c

feat: optionally time out eval steps (#3765)

3 months ago

telemetry.test.ts

e95800fcde

chore(telemetry): add isRunningInCi flag to telemetry events (#4115)

3 months ago

updates.test.ts

6b486a3954

test: configure default globalConfig mock and logger mock (#2915)

6 months ago

Comments

Use AWS S3 as storage!

Specify your S3 bucket

Access key (If needed)

Congratulations!

Use Google Cloud Storage!

Specify your Google Storage bucket

Service Account Key

Congratulations!

Use Azure Cloud Storage!

Specify your Azure Storage bucket

Access key (If needed)

Congratulations!

Use any S3 compatible storage!

Specify your S3 bucket

Access key (If needed)

Congratulations!

nirbarazida / promptfoo mirror of https://github.com/promptfoo/promptfoo

Comments

Use AWS S3 as storage!

Specify your S3 bucket

Access key (If needed)

Congratulations!

Use Google Cloud Storage!

Specify your Google Storage bucket

Service Account Key

Congratulations!

Use Azure Cloud Storage!

Specify your Azure Storage bucket

Access key (If needed)

Congratulations!

Use any S3 compatible storage!

Specify your S3 bucket

Access key (If needed)

Congratulations!

nirbarazida
/
promptfoo
mirror of https://github.com/promptfoo/promptfoo