Skip to content

Make agent and benchmark progress crash-safe - #19

Merged
wq19901103wq merged 1 commit into
mainfrom
codex/reliability-evidence
Jul 18, 2026
Merged

Make agent and benchmark progress crash-safe#19
wq19901103wq merged 1 commit into
mainfrom
codex/reliability-evidence

Conversation

@wq19901103wq

Copy link
Copy Markdown
Owner

Summary\n- atomically persist benchmark state and reports\n- checkpoint each system before and after execution with explicit status\n- classify infrastructure/budget failures as unfinished instead of wrong\n- reuse saved patches for evaluation-only retries without another model call\n- add durable direct-agent run summaries with duration and token usage\n\n## Validation\n- ruff format --check .\n- ruff check .\n- mypy agent tests\n- 36 targeted tests passed\n- full suite reached 192 passed, 3 skipped before being stopped to avoid competing with the active three-system Docker benchmark\n\nImplementation was developed in an isolated git worktree; the active comparison process was not restarted or modified.

@wq19901103wq
wq19901103wq force-pushed the codex/reliability-evidence branch from 5e5f181 to 83f473e Compare July 18, 2026 02:59
@wq19901103wq
wq19901103wq merged commit eaff11a into main Jul 18, 2026
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant