Skip to content

chore(deps): bump promptfoo from 0.121.11 to 0.121.15 in /tests/evals#680

Closed
dependabot[bot] wants to merge 1 commit into
mainfrom
dependabot/npm_and_yarn/tests/evals/promptfoo-0.121.15
Closed

chore(deps): bump promptfoo from 0.121.11 to 0.121.15 in /tests/evals#680
dependabot[bot] wants to merge 1 commit into
mainfrom
dependabot/npm_and_yarn/tests/evals/promptfoo-0.121.15

Conversation

@dependabot

@dependabot dependabot Bot commented on behalf of github Jun 11, 2026

Copy link
Copy Markdown
Contributor

Bumps promptfoo from 0.121.11 to 0.121.15.

Release notes

Sourced from promptfoo's releases.

0.121.15

0.121.15 (2026-06-05)

Features

  • assertions: grade multimodal outputs (#9617) (ec4d3b4)
  • build: add DAG-aware architecture cycle checks (#9557) (9d7d810)
  • providers: add Azure MAI image provider and MAI model recognition (#9595) (e091527)
  • providers: upgrade MiniMax default model to M3 (#9598) (43b30c5)

Bug Fixes

  • auth: enable auto-share for on-prem Report Server after login (#9612) (8ece593)
  • auth: preserve cloud request headers (#9610) (3a2c5e6)
  • code-scan: process findings in mixed skip responses (#9525) (aeae790)
  • code-scan: reject fractional inline comment lines (#9556) (0a2b329)
  • eval: compose metadata and result filters (#9604) (49539ee)
  • eval: preserve --config ordering when expanding a directory entry (#9606) (fc081a0)
  • harden validation and target discovery (#9614) (465d610)
  • providers: require deployment name for no-default Azure provider types (#9603) (da48abd)
  • providers: suppress optional GCP metadata warning (#9554) (8dcc44b)
  • redteam: restrict remote auth to cloud host (#9597) (1b2c6d9)

0.121.14

0.121.14 (2026-06-02)

Features

  • add A2A provider (#9586) (963b264)
  • assertions: add agent-rubric grader (#9453) (cadb3c5)
  • build: publish a lightweight promptfoo/contracts subpath (#9535) (6e89fd4)
  • cli: add seeded random sampling (#9522) (6e4ba60)
  • eval: extract eval-creator readiness and validation modules (#9397) (d3af118)
  • eval: surface trace linkage on result rows (#9027) (9468d66)
  • providers: add OpenAI GPT-5.5/5.4 frontier models + Codex on Amazon Bedrock (#9587) (1e35267)
  • providers: add OpenAI originator header (#9474) (6141070)
  • providers: expose traceable agent turn markers (#9475) (4018837)
  • providers: promote Fireworks AI from registry stub to dedicated provider (#9542) (2bae148)
  • tracing: add runtime receiver controls (#9028) (90df6a1)

Bug Fixes

  • assertions: don't classify gen_ai.tool.definitions chat spans as tool calls (#9524) (b59f397)
  • cli: preflight force imports before collision lookup (#9570) (0b93733)
  • cloud: on-prem API host for guardrails and http-generator, with host-resolution tests (#9580) (b9a014a)
  • cloud: use on-prem API host in checkEmailStatus (#9576) (063c62b)

... (truncated)

Changelog

Sourced from promptfoo's changelog.

0.121.15 (2026-06-05)

Features

  • assertions: grade multimodal outputs (#9617) (ec4d3b4)
  • build: add DAG-aware architecture cycle checks (#9557) (9d7d810)
  • providers: add Azure MAI image provider and MAI model recognition (#9595) (e091527)
  • providers: upgrade MiniMax default model to M3 (#9598) (43b30c5)

Bug Fixes

  • auth: enable auto-share for on-prem Report Server after login (#9612) (8ece593)
  • auth: preserve cloud request headers (#9610) (3a2c5e6)
  • code-scan: process findings in mixed skip responses (#9525) (aeae790)
  • code-scan: reject fractional inline comment lines (#9556) (0a2b329)
  • eval: compose metadata and result filters (#9604) (49539ee)
  • eval: preserve --config ordering when expanding a directory entry (#9606) (fc081a0)
  • harden validation and target discovery (#9614) (465d610)
  • providers: require deployment name for no-default Azure provider types (#9603) (da48abd)
  • providers: suppress optional GCP metadata warning (#9554) (8dcc44b)
  • redteam: restrict remote auth to cloud host (#9597) (1b2c6d9)

0.121.14 (2026-06-02)

Features

  • add A2A provider (#9586) (963b264)
  • assertions: add agent-rubric grader (#9453) (cadb3c5)
  • build: publish a lightweight promptfoo/contracts subpath (#9535) (6e89fd4)
  • cli: add seeded random sampling (#9522) (6e4ba60)
  • eval: extract eval-creator readiness and validation modules (#9397) (d3af118)
  • eval: surface trace linkage on result rows (#9027) (9468d66)
  • providers: add OpenAI GPT-5.5/5.4 frontier models + Codex on Amazon Bedrock (#9587) (1e35267)
  • providers: add OpenAI originator header (#9474) (6141070)
  • providers: expose traceable agent turn markers (#9475) (4018837)
  • providers: promote Fireworks AI from registry stub to dedicated provider (#9542) (2bae148)
  • tracing: add runtime receiver controls (#9028) (90df6a1)

Bug Fixes

  • assertions: don't classify gen_ai.tool.definitions chat spans as tool calls (#9524) (b59f397)
  • cli: preflight force imports before collision lookup (#9570) (0b93733)
  • cloud: on-prem API host for guardrails and http-generator, with host-resolution tests (#9580) (b9a014a)
  • cloud: use on-prem API host in checkEmailStatus (#9576) (063c62b)
  • db: avoid SQLITE_LOCKED flakiness in shared-cache test database (#9567) (1fdb59b)
  • db: serialize libsql test database cleanup (#9540) (f4380c2)
  • deps: keep ModelAudit pydantic-core pinned to compatible 2.46.4 (b2b35b0)
  • deps: update dependency ai to ^6.0.190 (#9577) (9ec614a)
  • eval: canonicalize retry JSONL output with atomic rewrites (#9547) (8d7c920)
  • eval: redact credentials from the persisted browser store (#9396) (4d5bed5)

... (truncated)

Commits

Dependabot compatibility score

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

  • @dependabot rebase will rebase this PR
  • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
  • @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
  • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

Bumps [promptfoo](https://github.com/promptfoo/promptfoo) from 0.121.11 to 0.121.15.
- [Release notes](https://github.com/promptfoo/promptfoo/releases)
- [Changelog](https://github.com/promptfoo/promptfoo/blob/main/CHANGELOG.md)
- [Commits](promptfoo/promptfoo@0.121.11...0.121.15)

---
updated-dependencies:
- dependency-name: promptfoo
  dependency-version: 0.121.15
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
@dependabot dependabot Bot added dependencies Pull requests that update a dependency file javascript Pull requests that update javascript code labels Jun 11, 2026
@github-actions github-actions Bot enabled auto-merge (squash) June 11, 2026 19:45
@dependabot @github

dependabot Bot commented on behalf of github Jun 18, 2026

Copy link
Copy Markdown
Contributor Author

Superseded by #685.

@dependabot dependabot Bot closed this Jun 18, 2026
auto-merge was automatically disabled June 18, 2026 19:44

Pull request was closed

@dependabot dependabot Bot deleted the dependabot/npm_and_yarn/tests/evals/promptfoo-0.121.15 branch June 18, 2026 19:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dependencies Pull requests that update a dependency file javascript Pull requests that update javascript code

Projects

None yet

Development

Successfully merging this pull request may close these issues.

0 participants