Skip to content

DOS-1471: cover Anthropic judge failure paths - #11

Open
mdostal wants to merge 1 commit into
agent/dostal-dev/083bf0d6from
dos-1471-anthropic-judge-tests
Open

DOS-1471: cover Anthropic judge failure paths#11
mdostal wants to merge 1 commit into
agent/dostal-dev/083bf0d6from
dos-1471-anthropic-judge-tests

Conversation

@mdostal

@mdostal mdostal commented Jul 22, 2026

Copy link
Copy Markdown

Summary

  • add fake-server coverage for AnthropicJudge.Score non-200 responses, Anthropic error envelopes, missing score tool_use blocks, malformed response JSON, malformed tool input, and in-flight context cancellation
  • add an end-to-end fake-server Score test proving out-of-range rubric values are clamped in Result

Test plan

  • go test ./internal/judge/...

Stacked on PR #9 because the judge package is introduced there and is not on main yet.

Co-authored-by: multica-agent <github@multica.ai>
@coderabbitai

coderabbitai Bot commented Jul 22, 2026

Copy link
Copy Markdown

Important

Review skipped

Auto reviews are disabled on base/target branches other than the default branch.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

⚙️ Run configuration

Configuration used: Organization UI

Review profile: ASSERTIVE

Plan: Pro

Run ID: 42e2d7eb-9142-4d4a-a70e-3fdadb630042

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

  • 🔍 Trigger review
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch dos-1471-anthropic-judge-tests

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant