nirbarazida/promptfoo

Michael D'Angelo c84efdf03a

Merge branch 'main' into chore/exit

10 months ago

Commits

__mocks__

81122a40cd

test: improve type safety and resolve TypeScript errors (#1216)

1 year ago

assertions

ad33256d02

chore: enforce consistent type imports (#1341)

1 year ago

commands

0ca26498c6

refactor(redteam): move redteam commands to src/redteam/commands (#1652)

11 months ago

is-sql-tests

551b87d6c8

fix: databaseType not database (#1451)

1 year ago

python

99062a50e0

feat: add real-time logging for Python script execution (#1818)

10 months ago

redteam

3d03d20049

fix: cross session templating (#1811)

10 months ago

account.test.ts

5c4d389ce7

feat: Cloud Login (#1719)

11 months ago

assertions.test.ts

a7d70f4bc2

fix: json parser handling for many braces (#1766)

11 months ago

cache.test.ts

de82edc426

fix: rate limiting handling (#1633)

11 months ago

checkNodeVersion.test.ts

0665ec88d5

refactor: simplify node version check (#1794)

10 months ago

csv.test.ts

8e6f4eed10

chore(providers): support file:// syntax for Python providers (#1748)

11 months ago

envars.test.ts

d1a88804da

refactor(providers): centralize cost calculation logic (#1679)

11 months ago

evaluator.test.ts

6acb66d710

feat: support input transforms (#1704)

10 months ago

evaluatorHelpers.test.ts

381d3eb98a

feat: extension hook api (#1249)

1 year ago

globalConfig.test.ts

5c4d389ce7

feat: Cloud Login (#1719)

11 months ago

index.test.ts

9dc5baa51c

fix: use provider prompt map when running via Node package (#1788)

10 months ago

matchers.test.ts

e662c3ebd6

feat(matchers): add external file loader for llm rubric (#1698)

11 months ago

onboarding.test.ts

d2145d4822

chore: warn if API keys are not present when running `promptfoo init` (#1577)

11 months ago

prompts.processors.javascript.test.ts

298c8be217

fix: re-add provider context in prompt functions (#1106)

1 year ago

prompts.processors.json.test.ts

9bd03d29e3

feat: normalize prompt input formats, introduce single responsibility handlers, improve test coverage, and fix minor bugs (#994)

1 year ago

prompts.processors.jsonl.test.ts

9bd03d29e3

feat: normalize prompt input formats, introduce single responsibility handlers, improve test coverage, and fix minor bugs (#994)

1 year ago

prompts.processors.markdown.test.ts

96306c3b1a

feat: add support for markdown prompts (#1616)

11 months ago

prompts.processors.python.test.ts

9bd03d29e3

feat: normalize prompt input formats, introduce single responsibility handlers, improve test coverage, and fix minor bugs (#994)

1 year ago

prompts.processors.python.utils.test.ts

c813dae06e

refactor: resolve circular dependencies and improve code organization (#1212)

1 year ago

prompts.processors.string.test.ts

ad33256d02

chore: enforce consistent type imports (#1341)

1 year ago

prompts.processors.text.test.ts

9bd03d29e3

feat: normalize prompt input formats, introduce single responsibility handlers, improve test coverage, and fix minor bugs (#994)

1 year ago

prompts.processors.yaml.test.ts

d6ffb9ad2f

fix: dont try to parse yaml content on load (#1226)

1 year ago

prompts.test.ts

7d5c4ab6d7

bugfix(prompts): add handling for function prompt (#1724)

11 months ago

prompts.utils.test.ts

c92c2e5a32

feat: helicone integration (#1434)

1 year ago

providers.anthropic.test.ts

d1a88804da

refactor(providers): centralize cost calculation logic (#1679)

11 months ago

providers.azure.test.ts

4be1266f7b

chore(providers): improve API URL formatting for Azure OpenAI provider (#1672)

11 months ago

providers.bedrock.test.ts

6af803b236

chore(bedrock): improve support for LLAMA3.1 and LLAMA3.2 model configuration (#1777)

11 months ago

providers.groq.test.ts

cd8b724dbf

feat(groq): integrate native Groq SDK and update documentation (#1479)

1 year ago

providers.http.test.ts

fdcaa99fdb

chore(providers): add support for file-based response parser for http provider (#1808)

10 months ago

providers.llama.test.ts

bbec5e9ed6

docs: add example and configuration guide for using llama.cpp (#1104)

1 year ago

providers.mistral.test.ts

091cfd5847

feat(mistral): update chat models and add embedding provider (#1614)

11 months ago

providers.pythonCompletion.test.ts

8e6f4eed10

chore(providers): support file:// syntax for Python providers (#1748)

11 months ago

providers.scriptCompletion.test.ts

23458937b9

fix(scriptCompletionProvider): handle UTF-8 encoding in script output (#1515)

1 year ago

providers.shared.test.ts

d1a88804da

refactor(providers): centralize cost calculation logic (#1679)

11 months ago

providers.test.ts

531564dd74

import directly

10 months ago

providers.vertex.test.ts

81122a40cd

test: improve type safety and resolve TypeScript errors (#1216)

1 year ago

rateLimit.test.ts

ee622119a1

feat: Migrate NextUI to a React App (#1637)

11 months ago

share.test.ts

761eb9c236

chore(cli): add option to strip auth info from shared URLs (#1304)

1 year ago

telemetry.test.ts

5c4d389ce7

feat: Cloud Login (#1719)

11 months ago

testCases.test.ts

0c99bc73a7

chore: support file:// prefix for local file paths in `tests:` field in config (#1651)

11 months ago

types.test.ts

af23ead586

test: refactor config validation to support 'targets' alias

11 months ago

updates.test.ts

a693785072

chore(deps): update @swc/core to version 1.7.1 (#1285)

1 year ago

util.config.default.test.ts

1306548b71

fix(redteam): read redteam config during redteam eval command (#1803)

10 months ago

util.config.load.test.ts.ts

8d6c1b9440

fix: prompts per provider (#1757)

11 months ago

util.config.main.test.ts

ed91c030c4

chore: search directory paths for config files (#1721)

11 months ago

util.generation.test.ts

7480efc836

chore(testCases): improve test case generation with retry logic (#1544)

1 year ago

util.json.test.ts

a7d70f4bc2

fix: json parser handling for many braces (#1766)

11 months ago

util.templates.test.ts

7303b202e1

feat(templates): allow Nunjucks templating in grader context (#1606)

11 months ago

util.test.ts

9656444638

feat(util): add nunjucks template support for file path (#1688)

11 months ago

util.transform.test.ts

6acb66d710

feat: support input transforms (#1704)

10 months ago

utils.ts

ad33256d02

chore: enforce consistent type imports (#1341)

1 year ago

Comments

Use AWS S3 as storage!

Specify your S3 bucket

Access key (If needed)

Congratulations!

Use Google Cloud Storage!

Specify your Google Storage bucket

Service Account Key

Congratulations!

Use Azure Cloud Storage!

Specify your Azure Storage bucket

Access key (If needed)

Congratulations!

Use any S3 compatible storage!

Specify your S3 bucket

Access key (If needed)

Congratulations!

nirbarazida / promptfoo mirror of https://github.com/promptfoo/promptfoo

Comments

Use AWS S3 as storage!

Specify your S3 bucket

Access key (If needed)

Congratulations!

Use Google Cloud Storage!

Specify your Google Storage bucket

Service Account Key

Congratulations!

Use Azure Cloud Storage!

Specify your Azure Storage bucket

Access key (If needed)

Congratulations!

Use any S3 compatible storage!

Specify your S3 bucket

Access key (If needed)

Congratulations!

nirbarazida
/
promptfoo
mirror of https://github.com/promptfoo/promptfoo