nirbarazida/promptfoo

Will abaf4fa347

chore(providers): Improve guardrails handling in Azure providers (#4788)

1 month ago

Commits

__mocks__

81122a40cd

test: improve type safety and resolve TypeScript errors (#1216)

1 year ago

assertions

3bd7a3ebb6

test: add unit test for src/assertions/guardrails.ts (#4765)

1 month ago

commands

3e5d31a14f

feat(config): add support for loading defaultTest from external files (#4720)

1 month ago

database

ff6b4c0b96

feat: enable WAL mode for SQLite (#4104)

2 months ago

evaluator

bde6060d64

feat: add traces to javascript, python asserts (#4745)

1 month ago

factories

e351003869

feat: Server-side pagination, filtering and search for eval results table (#4054)

3 months ago

globalConfig

cd944496d9

fix(telemetry): prevent PostHog initialization when telemetry is disabled (#4772)

1 month ago

integrations

52a3be994a

test: fix huggingface dataset tests to mock environment variables (#3936)

3 months ago

matchers

425e2fa7ca

test: isolate mocks so tests can run in any order with --randomize (#4744)

1 month ago

models

b4870fcbd0

fix: empty vars array on eval results (#4621)

2 months ago

prompts

2411342d24

chore: Improve telemetry delivery (#4655)

2 months ago

providers

abaf4fa347

chore(providers): Improve guardrails handling in Azure providers (#4788)

1 month ago

python

79aa4b779a

chore(internals): remove python script result data type debug log (#4807)

1 month ago

redteam

1722d62970

fix: respect PROMPTFOO_DISABLE_REDTEAM_REMOTE_GENERATION for cloud users (#4839)

1 month ago

server

67a833e60f

test: add unit test for src/server/routes/providers.ts (#4658)

2 months ago

site

f90fe98182

chore: remove redundant test comments (#4183)

3 months ago

testCase

a1caaebcb6

refactor: split test case loading from synthesis (#3004)

6 months ago

tracing

6c51a9456f

feat: opentelemetry tracing support (#4600)

2 months ago

types

3e5d31a14f

feat(config): add support for loading defaultTest from external files (#4720)

1 month ago

util

6b5bbbedbc

fix: add glob pattern support for loading scenario files (#4761)

1 month ago

validators

a9c90f612b

test: add unit test for src/validators/redteam.ts (#4803)

1 month ago

account.test.ts

2411342d24

chore: Improve telemetry delivery (#4655)

2 months ago

cache.test.ts

47b4f15856

chore: expose `deleteFromCache` to evict cache keys after fetch by providers (#3009)

6 months ago

checkNodeVersion.test.ts

6b486a3954

test: configure default globalConfig mock and logger mock (#2915)

7 months ago

config-schema.test.ts

6d1d880fc0

fix(schema): remove duplicate 'bias' entry in config-schema.json (#4773)

1 month ago

constants.test.ts

84201e54bf

chore(redteam): add centralized REDTEAM_DEFAULTS and maxConcurrency support (#4656)

2 months ago

csv.test.ts

026caa8577

chore: improve __metadata warning message and test coverage (#4842)

1 month ago

database.test.ts

ff6b4c0b96

feat: enable WAL mode for SQLite (#4104)

2 months ago

envars.test.ts

34896542a2

feat: add maximum evaluation time limit with PROMPTFOO_MAX_EVAL_TIME_MS (#4322)

2 months ago

esm.test.ts

361e8b6e56

fix: broken handling of absolute paths in hook/code import (#3060)

6 months ago

evaluator.test.ts

3e5d31a14f

feat(config): add support for loading defaultTest from external files (#4720)

1 month ago

evaluatorHelpers.test.ts

95d57259f0

chore(cli): Removes context schema validation from extension hooks (#4622)

2 months ago

feedback.test.ts

5dfa39ca8e

refactor: centralize readline utilities to fix Jest open handle issues (#4219)

3 months ago

fetch.test.ts

eea9239da3

fix: add timeout to ProxyAgent (#4369)

2 months ago

generated-constants.test.ts

5f8300a269

test: add integrity check for generated-constants.ts (#4753)

1 month ago

globalConfig.test.ts

2411342d24

chore: Improve telemetry delivery (#4655)

2 months ago

googleSheets.test.ts

2ecfd1a110

chore: update Google Sheets fetch to use proxy helper (#4087)

3 months ago

guardrails.test.ts

a08fc4e4da

feat(eval): track assertion tokens in token usage (#3551)

4 months ago

index.test.ts

3e5d31a14f

feat(config): add support for loading defaultTest from external files (#4720)

1 month ago

logger.test.ts

7f6ffe53ec

fix(logger): fix `[Object object]` empty string error (#3638)

4 months ago

main.test.ts

131c36dd4c

chore: add global env-file option to all commands recursively (#3969)

3 months ago

onboarding.test.ts

2411342d24

chore: Improve telemetry delivery (#4655)

2 months ago

providers.test.ts

ec4240a754

feat(redteam): Cloud-based plugin severity overrides (#4348)

2 months ago

rateLimit.test.ts

8494c43824

chore: replace node-fetch with native fetch API (#1968)

10 months ago

sagemaker.test.ts

6a4b257262

chore(providers/sagemaker): Improves validation of user-provided config (#4809)

1 month ago

share.test.ts

7162bc3a9e

fix(sharing): Fix file outputs when sharing (#4698)

2 months ago

table.test.ts

a938e4b52c

feat: optionally time out eval steps (#3765)

4 months ago

telemetry.test.ts

5aba1c3214

chore(telemetry): Identify to PostHog whether user is also cloud user (#4782)

1 month ago

updates.test.ts

6b486a3954

test: configure default globalConfig mock and logger mock (#2915)

7 months ago

Comments

Use AWS S3 as storage!

Specify your S3 bucket

Access key (If needed)

Congratulations!

Use Google Cloud Storage!

Specify your Google Storage bucket

Service Account Key

Congratulations!

Use Azure Cloud Storage!

Specify your Azure Storage bucket

Access key (If needed)

Congratulations!

Use any S3 compatible storage!

Specify your S3 bucket

Access key (If needed)

Congratulations!

nirbarazida / promptfoo mirror of https://github.com/promptfoo/promptfoo

Comments

Use AWS S3 as storage!

Specify your S3 bucket

Access key (If needed)

Congratulations!

Use Google Cloud Storage!

Specify your Google Storage bucket

Service Account Key

Congratulations!

Use Azure Cloud Storage!

Specify your Azure Storage bucket

Access key (If needed)

Congratulations!

Use any S3 compatible storage!

Specify your S3 bucket

Access key (If needed)

Congratulations!

nirbarazida
/
promptfoo
mirror of https://github.com/promptfoo/promptfoo