Skip to content

docs(eval): add README for running evals locally#249

Open
fullsend-ai-coder[bot] wants to merge 1 commit into
mainfrom
agent/247-eval-readme
Open

docs(eval): add README for running evals locally#249
fullsend-ai-coder[bot] wants to merge 1 commit into
mainfrom
agent/247-eval-readme

Conversation

@fullsend-ai-coder

Copy link
Copy Markdown
Contributor

Summary

  • Add eval/README.md documenting how to run agent evals locally
  • Covers prerequisites (tools, GCP credentials, GitHub token scopes), required env vars, run commands, test case structure, and known issues
  • Documents both review and triage eval workflows since they share the same infrastructure

Closes #247

Test plan

🤖 Generated with Claude Code


Closes #247

Post-script verification

  • Branch is not main/master (agent/247-eval-readme)
  • Secret scan passed (gitleaks — def8cb529ebf40b98eb0c0b67a2793b46f7648e4..HEAD)
  • PR body secret scan passed (gitleaks — no-git)
  • Pre-commit hooks passed (authoritative run on runner)
  • Tests ran inside sandbox

Document prerequisites, required env vars, run commands, test case
structure, and known issues for the eval framework. Covers both
review and triage agents.

Closes #247

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
@fullsend-ai-coder
fullsend-ai-coder Bot requested a review from a team as a code owner July 17, 2026 08:57
@ben-alkov ben-alkov added the documentation Improvements or additions to documentation label Jul 17, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

documentation Improvements or additions to documentation

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Document how to run review eval locally

1 participant