nirbarazida/promptfoo

...

__mocks__

81122a40cd

test: improve type safety and resolve TypeScript errors (#1216)

1 year ago

assertions

907e249cfc

fix: use ajv with formats everywhere (#3716)

4 months ago

commands

dab372fe43

chore(eval): add warning for redteam config without test cases (#3740)

4 months ago

factories

06e38a4469

chore(cli/redteam/run): Default to outputting generated Redteam config in same dir as input config (#3721)

4 months ago

globalConfig

10d50f8835

chore(auth): improve login text formatting (#3389)

5 months ago

integrations

b34095e4be

fix(huggingface): disable var expansion for huggingface datasets to prevent array field expansion (#3687)

4 months ago

models

a08fc4e4da

feat(eval): track assertion tokens in token usage (#3551)

4 months ago

prompts

0c58ee772e

feat(prompts): add support for loading prompts from CSV files (#3542)

4 months ago

providers

82675034c5

feat: update openai grading model to gpt 4.1 (#3741)

4 months ago

python

7b81997c30

test: add unit test for src/python/pythonUtils.ts (#3508)

5 months ago

redteam

a19acddd9f

chore(redteam): Add canGenerateRemote property to redteam plugins (#3761)

4 months ago

server

fa9822e2d3

test: add unit test for src/server/server.ts (#3198)

6 months ago

testCase

a1caaebcb6

refactor: split test case loading from synthesis (#3004)

6 months ago

types

3e264556ab

refactor(tests): consolidate and reorganize test files (#3616)

4 months ago

util

cd8c5726a1

chore: improve readline handling and tests (#3763)

4 months ago

account.test.ts

5c4d389ce7

feat: Cloud Login (#1719)

11 months ago

cache.test.ts

47b4f15856

chore: expose `deleteFromCache` to evict cache keys after fetch by providers (#3009)

6 months ago

checkNodeVersion.test.ts

6b486a3954

test: configure default globalConfig mock and logger mock (#2915)

6 months ago

csv.test.ts

b96c7e0f61

feat: google valid function call (#3605)

4 months ago

envars.test.ts

d1a88804da

refactor(providers): centralize cost calculation logic (#1679)

11 months ago

esm.test.ts

361e8b6e56

fix: broken handling of absolute paths in hook/code import (#3060)

6 months ago

evaluator.test.ts

2889450e31

fix(evaluator): handle prompt rendering errors gracefully (#3729)

4 months ago

evaluatorHelpers.test.ts

31a2a6dea1

chore(schema): make extensions field nullable (#3611)

4 months ago

feedback.test.ts

cd8c5726a1

chore: improve readline handling and tests (#3763)

4 months ago

fetch.test.ts

7af9fda286

chore: PROMPTFOO_INSECURE_SSL true by default (#3397)

5 months ago

globalConfig.test.ts

6b486a3954

test: configure default globalConfig mock and logger mock (#2915)

6 months ago

googleSheets.test.ts

564ef63bc8

chore: Fix an error in Google SpreadSheet(Authenticated) with a header without a value (#3255)

5 months ago

guardrails.test.ts

a08fc4e4da

feat(eval): track assertion tokens in token usage (#3551)

4 months ago

index.test.ts

a08fc4e4da

feat(eval): track assertion tokens in token usage (#3551)

4 months ago

logger.test.ts

7f6ffe53ec

fix(logger): fix `[Object object]` empty string error (#3638)

4 months ago

matchers.test.ts

94e42c08b7

feat(assertions): Modify LLM Rubric rubricPrompt rendering to support arbitrary objects (#3746)

4 months ago

onboarding.test.ts

6b486a3954

test: configure default globalConfig mock and logger mock (#2915)

6 months ago

providers.test.ts

d2b7e6eef6

fix: handle providers array with file references to multiple providers #3609 (#3617)

4 months ago

rateLimit.test.ts

8494c43824

chore: replace node-fetch with native fetch API (#1968)

10 months ago

sagemaker.test.ts

fcf6ac48f9

feat(providers): add support for Amazon SageMaker (#3413)

5 months ago

share.test.ts

fdfeb8a295

feat(evals): Sharing Idempotence (#3653)

4 months ago

table.test.ts

c953cde0a9

fix(cli): list command for datasets (#3163)

6 months ago

telemetry.test.ts

5c4d389ce7

feat: Cloud Login (#1719)

11 months ago

updates.test.ts

6b486a3954

test: configure default globalConfig mock and logger mock (#2915)

6 months ago

Specify your S3 bucket

Bucket name cannot be the same as the repository name. Please change one of them.

Bucket url and prefix

Region

Endpoint Url

Disable SSL verification

Comments

Use AWS S3 as storage!

Specify your S3 bucket

Access key (If needed)

Congratulations!

Use Google Cloud Storage!

Specify your Google Storage bucket

Service Account Key

Congratulations!

Use Azure Cloud Storage!

Specify your Azure Storage bucket

Access key (If needed)

Congratulations!

Use any S3 compatible storage!

Specify your S3 bucket

Access key (If needed)

Congratulations!

nirbarazida / promptfoo mirror of https://github.com/promptfoo/promptfoo

Comments

Use AWS S3 as storage!

Specify your S3 bucket

Access key (If needed)

Congratulations!

Use Google Cloud Storage!

Specify your Google Storage bucket

Service Account Key

Congratulations!

Use Azure Cloud Storage!

Specify your Azure Storage bucket

Access key (If needed)

Congratulations!

Use any S3 compatible storage!

Specify your S3 bucket

Access key (If needed)

Congratulations!

nirbarazida
/
promptfoo
mirror of https://github.com/promptfoo/promptfoo