Skip to content

fix: exit nonzero on mediated demo regressions#42

Merged
rlippmann merged 1 commit into
mainfrom
codex/demo-failure-regression
Mar 18, 2026
Merged

fix: exit nonzero on mediated demo regressions#42
rlippmann merged 1 commit into
mainfrom
codex/demo-failure-regression

Conversation

@rlippmann

Copy link
Copy Markdown
Owner

What changed

  • Updated demos/run_demo.py to return nonzero exit code for mediated regressions in scored demos.
  • Added/updated tests in tests/test_run_demo.py for single/all mode nonzero behavior, zero behavior for non-regressions, and preserved error handling semantics.

Why

Callers need machine-detectable failure when compiler-mediated regressions are detected, while preserving existing warning text and informational demo behavior.

@rlippmann
rlippmann merged commit 6347926 into main Mar 18, 2026
8 checks passed
@rlippmann
rlippmann deleted the codex/demo-failure-regression branch March 18, 2026 05:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant