nirbarazida/promptfoo

Ian Webster e1cbad3801

feat: make config `prompt` optional

11 months ago

Commits

__mocks__

81122a40cd

test: improve type safety and resolve TypeScript errors (#1216)

1 year ago

assertions

ad33256d02

chore: enforce consistent type imports (#1341)

1 year ago

commands

0ca26498c6

refactor(redteam): move redteam commands to src/redteam/commands (#1652)

11 months ago

is-sql-tests

551b87d6c8

fix: databaseType not database (#1451)

1 year ago

python

0bf96762bf

feat(python): add validatePythonPath function and improve error handling (#1670)

11 months ago

redteam

21f4d639b2

docs: update model references from gpt-3.5-turbo to gpt-4o-mini (#1655)

11 months ago

account.test.ts

618d22959e

feat: override author attribute via env var for ci (#1099)

1 year ago

assertions.test.ts

2ec15c7cdd

fix(assertions): fix error in latency assertion for 0 ms latency (#1668)

11 months ago

cache.test.ts

de82edc426

fix: rate limiting handling (#1633)

11 months ago

checkNodeVersion.test.ts

85eedf868d

chore: add Node.js version check to ensure compatibility (#1030)

1 year ago

config.test.ts

e1cbad3801

feat: make config `prompt` optional

11 months ago

csv.test.ts

6e4fdcd886

chore: sort imports (#1006)

1 year ago

envars.test.ts

d1a88804da

refactor(providers): centralize cost calculation logic (#1679)

11 months ago

evaluator.test.ts

381d3eb98a

feat: extension hook api (#1249)

1 year ago

evaluatorHelpers.test.ts

381d3eb98a

feat: extension hook api (#1249)

1 year ago

globalConfig.test.ts

6e4fdcd886

chore: sort imports (#1006)

1 year ago

index.test.ts

349f4d8cda

refactor(redteam): remove deprecated exports from redteam object

11 months ago

main.test.ts

5a6ab2f24d

fix: expand supported config file extensions (#1473)

1 year ago

matchers.test.ts

21f4d639b2

docs: update model references from gpt-3.5-turbo to gpt-4o-mini (#1655)

11 months ago

onboarding.test.ts

d2145d4822

chore: warn if API keys are not present when running `promptfoo init` (#1577)

11 months ago

prompts.processors.javascript.test.ts

298c8be217

fix: re-add provider context in prompt functions (#1106)

1 year ago

prompts.processors.json.test.ts

9bd03d29e3

feat: normalize prompt input formats, introduce single responsibility handlers, improve test coverage, and fix minor bugs (#994)

1 year ago

prompts.processors.jsonl.test.ts

9bd03d29e3

feat: normalize prompt input formats, introduce single responsibility handlers, improve test coverage, and fix minor bugs (#994)

1 year ago

prompts.processors.markdown.test.ts

96306c3b1a

feat: add support for markdown prompts (#1616)

11 months ago

prompts.processors.python.test.ts

9bd03d29e3

feat: normalize prompt input formats, introduce single responsibility handlers, improve test coverage, and fix minor bugs (#994)

1 year ago

prompts.processors.python.utils.test.ts

c813dae06e

refactor: resolve circular dependencies and improve code organization (#1212)

1 year ago

prompts.processors.string.test.ts

ad33256d02

chore: enforce consistent type imports (#1341)

1 year ago

prompts.processors.text.test.ts

9bd03d29e3

feat: normalize prompt input formats, introduce single responsibility handlers, improve test coverage, and fix minor bugs (#994)

1 year ago

prompts.processors.yaml.test.ts

d6ffb9ad2f

fix: dont try to parse yaml content on load (#1226)

1 year ago

prompts.test.ts

d6ffb9ad2f

fix: dont try to parse yaml content on load (#1226)

1 year ago

prompts.utils.test.ts

c92c2e5a32

feat: helicone integration (#1434)

1 year ago

providers.anthropic.test.ts

d1a88804da

refactor(providers): centralize cost calculation logic (#1679)

11 months ago

providers.azure.test.ts

4be1266f7b

chore(providers): improve API URL formatting for Azure OpenAI provider (#1672)

11 months ago

providers.bedrock.test.ts

ad33256d02

chore: enforce consistent type imports (#1341)

1 year ago

providers.groq.test.ts

cd8b724dbf

feat(groq): integrate native Groq SDK and update documentation (#1479)

1 year ago

providers.http.test.ts

a51b71c8f1

fix!: handle json objects in http provider (#1274)

1 year ago

providers.llama.test.ts

bbec5e9ed6

docs: add example and configuration guide for using llama.cpp (#1104)

1 year ago

providers.mistral.test.ts

091cfd5847

feat(mistral): update chat models and add embedding provider (#1614)

11 months ago

providers.pythonCompletion.test.ts

b22e68e040

fix: include vars in python provider cache key (#1493)

1 year ago

providers.scriptCompletion.test.ts

23458937b9

fix(scriptCompletionProvider): handle UTF-8 encoding in script output (#1515)

1 year ago

providers.shared.test.ts

d1a88804da

refactor(providers): centralize cost calculation logic (#1679)

11 months ago

providers.test.ts

cd48ec371b

chore(openai): improve support for structured outputs (#1656)

11 months ago

providers.vertex.test.ts

81122a40cd

test: improve type safety and resolve TypeScript errors (#1216)

1 year ago

rateLimit.test.ts

de82edc426

fix: rate limiting handling (#1633)

11 months ago

share.test.ts

761eb9c236

chore(cli): add option to strip auth info from shared URLs (#1304)

1 year ago

telemetry.test.ts

fdd33d64bb

fix(redteam): cli nits, plugins, and provider functionality, and documetation (#1231)

1 year ago

testCases.test.ts

0c99bc73a7

chore: support file:// prefix for local file paths in `tests:` field in config (#1651)

11 months ago

types.test.ts

21f4d639b2

docs: update model references from gpt-3.5-turbo to gpt-4o-mini (#1655)

11 months ago

updates.test.ts

a693785072

chore(deps): update @swc/core to version 1.7.1 (#1285)

1 year ago

util.config.test.ts

ad5fe92a0f

feat(config): add writePromptfooConfig function and orderKeys utility (#1360)

1 year ago

util.generation.test.ts

7480efc836

chore(testCases): improve test case generation with retry logic (#1544)

1 year ago

util.json.test.ts

5612950974

fix: json parsing infinite loop (#1590)

11 months ago

util.templates.test.ts

7303b202e1

feat(templates): allow Nunjucks templating in grader context (#1606)

11 months ago

util.test.ts

b93b25adcb

refactor: move extractJsonObjects to json utility module (#1539)

1 year ago

util.transform.test.ts

381d3eb98a

feat: extension hook api (#1249)

1 year ago

utils.ts

ad33256d02

chore: enforce consistent type imports (#1341)

1 year ago

Comments

Use AWS S3 as storage!

Specify your S3 bucket

Access key (If needed)

Congratulations!

Use Google Cloud Storage!

Specify your Google Storage bucket

Service Account Key

Congratulations!

Use Azure Cloud Storage!

Specify your Azure Storage bucket

Access key (If needed)

Congratulations!

Use any S3 compatible storage!

Specify your S3 bucket

Access key (If needed)

Congratulations!

nirbarazida / promptfoo mirror of https://github.com/promptfoo/promptfoo

Comments

Use AWS S3 as storage!

Specify your S3 bucket

Access key (If needed)

Congratulations!

Use Google Cloud Storage!

Specify your Google Storage bucket

Service Account Key

Congratulations!

Use Azure Cloud Storage!

Specify your Azure Storage bucket

Access key (If needed)

Congratulations!

Use any S3 compatible storage!

Specify your S3 bucket

Access key (If needed)

Congratulations!

nirbarazida
/
promptfoo
mirror of https://github.com/promptfoo/promptfoo