Summary
Add a functional eval under eval/fix/ that runs the real fix agent pipeline against an existing PR fixture (human /fs-fix via env) and asserts the post-script pushes a new commit touching calc.py.
Motivation
Regression guard for the fix pipeline (human trigger path). Code eval (#180 / PR #177) covers issue→PR; fix needs existing-PR→new-commit.
Acceptance criteria
Summary
Add a functional eval under
eval/fix/that runs the real fix agent pipeline against an existing PR fixture (human/fs-fixvia env) and asserts the post-script pushes a new commit touchingcalc.py.Motivation
Regression guard for the fix pipeline (human trigger path). Code eval (#180 / PR #177) covers issue→PR; fix needs existing-PR→new-commit.
Acceptance criteria
eval/fix/with at least one human/fs-fixcaseHUMAN_INSTRUCTION,PRE_AGENT_HEAD, emptyREVIEW_BODY_FILE) and checkout PR headhead_sha,files,pre_agent_headfor judgesfix