Skip to content

chore(deps): bump promptfoo from 0.121.11 to 0.121.14 in /tests/evals#674

Closed
dependabot[bot] wants to merge 1 commit into
mainfrom
dependabot/npm_and_yarn/tests/evals/promptfoo-0.121.14
Closed

chore(deps): bump promptfoo from 0.121.11 to 0.121.14 in /tests/evals#674
dependabot[bot] wants to merge 1 commit into
mainfrom
dependabot/npm_and_yarn/tests/evals/promptfoo-0.121.14

Conversation

@dependabot

@dependabot dependabot Bot commented on behalf of github Jun 4, 2026

Copy link
Copy Markdown
Contributor

Bumps promptfoo from 0.121.11 to 0.121.14.

Release notes

Sourced from promptfoo's releases.

0.121.14

0.121.14 (2026-06-02)

Features

  • add A2A provider (#9586) (963b264)
  • assertions: add agent-rubric grader (#9453) (cadb3c5)
  • build: publish a lightweight promptfoo/contracts subpath (#9535) (6e89fd4)
  • cli: add seeded random sampling (#9522) (6e4ba60)
  • eval: extract eval-creator readiness and validation modules (#9397) (d3af118)
  • eval: surface trace linkage on result rows (#9027) (9468d66)
  • providers: add OpenAI GPT-5.5/5.4 frontier models + Codex on Amazon Bedrock (#9587) (1e35267)
  • providers: add OpenAI originator header (#9474) (6141070)
  • providers: expose traceable agent turn markers (#9475) (4018837)
  • providers: promote Fireworks AI from registry stub to dedicated provider (#9542) (2bae148)
  • tracing: add runtime receiver controls (#9028) (90df6a1)

Bug Fixes

  • assertions: don't classify gen_ai.tool.definitions chat spans as tool calls (#9524) (b59f397)
  • cli: preflight force imports before collision lookup (#9570) (0b93733)
  • cloud: on-prem API host for guardrails and http-generator, with host-resolution tests (#9580) (b9a014a)
  • cloud: use on-prem API host in checkEmailStatus (#9576) (063c62b)
  • db: avoid SQLITE_LOCKED flakiness in shared-cache test database (#9567) (1fdb59b)
  • db: serialize libsql test database cleanup (#9540) (f4380c2)
  • deps: keep ModelAudit pydantic-core pinned to compatible 2.46.4 (b2b35b0)
  • deps: update dependency ai to ^6.0.190 (#9577) (9ec614a)
  • eval: canonicalize retry JSONL output with atomic rewrites (#9547) (8d7c920)
  • eval: redact credentials from the persisted browser store (#9396) (4d5bed5)
  • evaluator: preserve and harden programmatic JSONL output (#9538) (8ddd906)
  • output: redact api-key and legacy transport headers in JSONL/DB (#9546) (e194c85)
  • providers: handle Codex SDK rate limits (#9473) (76d3db4)
  • providers: inject n8n sessions into custom bodies (#9527) (9cc0542)
  • providers: preserve n8n array body templates (#9544) (6cdf63d)
  • providers: preserve streamed Anthropic refusal guardrails (#9560) (ff8eafd)
  • providers: serialize persistent browser sessions (#9414) (097ff9b)
  • redteam: authenticate remote-generation requests against on-prem cloud (#9584) (7df8fae)
  • util: restore nested SAS tokens after array reorder (#9528) (9759e5a)
  • webui: render negative-only metric charts (#9526) (7ccafa4)

0.121.13

0.121.13 (2026-05-28)

Features

... (truncated)

Changelog

Sourced from promptfoo's changelog.

0.121.14 (2026-06-02)

Features

  • add A2A provider (#9586) (963b264)
  • assertions: add agent-rubric grader (#9453) (cadb3c5)
  • build: publish a lightweight promptfoo/contracts subpath (#9535) (6e89fd4)
  • cli: add seeded random sampling (#9522) (6e4ba60)
  • eval: extract eval-creator readiness and validation modules (#9397) (d3af118)
  • eval: surface trace linkage on result rows (#9027) (9468d66)
  • providers: add OpenAI GPT-5.5/5.4 frontier models + Codex on Amazon Bedrock (#9587) (1e35267)
  • providers: add OpenAI originator header (#9474) (6141070)
  • providers: expose traceable agent turn markers (#9475) (4018837)
  • providers: promote Fireworks AI from registry stub to dedicated provider (#9542) (2bae148)
  • tracing: add runtime receiver controls (#9028) (90df6a1)

Bug Fixes

  • assertions: don't classify gen_ai.tool.definitions chat spans as tool calls (#9524) (b59f397)
  • cli: preflight force imports before collision lookup (#9570) (0b93733)
  • cloud: on-prem API host for guardrails and http-generator, with host-resolution tests (#9580) (b9a014a)
  • cloud: use on-prem API host in checkEmailStatus (#9576) (063c62b)
  • db: avoid SQLITE_LOCKED flakiness in shared-cache test database (#9567) (1fdb59b)
  • db: serialize libsql test database cleanup (#9540) (f4380c2)
  • deps: keep ModelAudit pydantic-core pinned to compatible 2.46.4 (b2b35b0)
  • deps: update dependency ai to ^6.0.190 (#9577) (9ec614a)
  • eval: canonicalize retry JSONL output with atomic rewrites (#9547) (8d7c920)
  • eval: redact credentials from the persisted browser store (#9396) (4d5bed5)
  • evaluator: preserve and harden programmatic JSONL output (#9538) (8ddd906)
  • output: redact api-key and legacy transport headers in JSONL/DB (#9546) (e194c85)
  • providers: handle Codex SDK rate limits (#9473) (76d3db4)
  • providers: inject n8n sessions into custom bodies (#9527) (9cc0542)
  • providers: preserve n8n array body templates (#9544) (6cdf63d)
  • providers: preserve streamed Anthropic refusal guardrails (#9560) (ff8eafd)
  • providers: serialize persistent browser sessions (#9414) (097ff9b)
  • redteam: authenticate remote-generation requests against on-prem cloud (#9584) (7df8fae)
  • util: restore nested SAS tokens after array reorder (#9528) (9759e5a)
  • webui: render negative-only metric charts (#9526) (7ccafa4)

0.121.13 (2026-05-28)

Features

  • add MiniMax provider (#8207) (ebd78f6)
  • anthropic: add support for Claude Opus 4.8 (#9500) (e090730)
  • assertions: add ignore option to trajectory:tool-args-match (#9466) (6423f2a)
  • assertions: add metadata shortcut to assertion context (#6863) (5264680)
  • assertions: support glob patterns in trajectory:tool-args-match ignore (#9484) (18b3eef)
  • assertions: tolerate optional defaults in trajectory:tool-args-match (#9471) (a74894a)
  • cli: add prompt optimization (#9294) (27d6dbe)

... (truncated)

Commits
  • 7a48c5f chore(main): release 0.121.14 (#9521)
  • 96e5565 refactor(assertions): decouple function call validation (#9550)
  • 1e35267 feat(providers): add OpenAI GPT-5.5/5.4 frontier models + Codex on Amazon Bed...
  • ef2c793 refactor(redteam): adopt input contracts in UI (#9549)
  • a84354c refactor(api): extract browser user contracts to leaf-safe surface (#9548)
  • 8d7c920 fix(eval): canonicalize retry JSONL output with atomic rewrites (#9547)
  • d27868b docs(agents): add subsystem AGENTS.md context files (#9579)
  • 7df8fae fix(redteam): authenticate remote-generation requests against on-prem cloud (...
  • 963b264 feat: add A2A provider (#9586)
  • 90df6a1 feat(tracing): add runtime receiver controls (#9028)
  • Additional commits viewable in compare view

Dependabot compatibility score

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

  • @dependabot rebase will rebase this PR
  • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
  • @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
  • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

Bumps [promptfoo](https://github.com/promptfoo/promptfoo) from 0.121.11 to 0.121.14.
- [Release notes](https://github.com/promptfoo/promptfoo/releases)
- [Changelog](https://github.com/promptfoo/promptfoo/blob/main/CHANGELOG.md)
- [Commits](promptfoo/promptfoo@0.121.11...0.121.14)

---
updated-dependencies:
- dependency-name: promptfoo
  dependency-version: 0.121.14
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
@dependabot dependabot Bot added dependencies Pull requests that update a dependency file javascript Pull requests that update javascript code labels Jun 4, 2026
@github-actions github-actions Bot enabled auto-merge (squash) June 4, 2026 19:44
@dependabot @github

dependabot Bot commented on behalf of github Jun 11, 2026

Copy link
Copy Markdown
Contributor Author

Superseded by #680.

@dependabot dependabot Bot closed this Jun 11, 2026
auto-merge was automatically disabled June 11, 2026 19:44

Pull request was closed

@dependabot dependabot Bot deleted the dependabot/npm_and_yarn/tests/evals/promptfoo-0.121.14 branch June 11, 2026 19:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dependencies Pull requests that update a dependency file javascript Pull requests that update javascript code

Projects

None yet

Development

Successfully merging this pull request may close these issues.

0 participants