Skip to content

native_proof_regressions: 16 tests red on main, and the suite is not per-PR gated #7245

Description

@proggeramlug

crates/perry-codegen/tests/native_proof_regressions.rs has 16 failing tests on main, verified against an unmodified tree at origin/main during #7242:

  • 15 × invalidation::*
  • typed_f64_receiver_method_clone_raw_loads_after_composed_guards

They are unrelated to #7242 (that PR's diff does not touch them; the same 16 fail with and without it).

Why this matters more than 16 red tests

This is the CLAUDE.md failure mode "integration suites under crates/*/tests/*.rs do not run per-PR (nightly/tag only) — a regression there can land green and sit red for days" (#5960), observed live.

These tests guard native-proof invalidation — precisely the machinery that decides when a type proof stops being valid. That is a soundness-relevant surface: #7242 was merged because an unsound specialization pass produced silently wrong arithmetic, and the suite that would notice a proof-invalidation regression is not consulted on any PR.

Asks

  1. Triage the 16 — are they stale expectations, or real invalidation regressions? The distinction matters: the second case means proofs are surviving events that should kill them.
  2. Get this suite (or a cargo-test-visible subset of it) into the per-PR gate, per CI: PR cargo-test never executes crates/perry integration suites; main-push full run starves under merge trains (documented near-miss) #5960's standing recommendation.
  3. Whichever way (1) resolves, the suite must not be left red — a permanently-red suite trains everyone to ignore it, which is failure mode (1) by a different route.

Found during #7242. Not a blocker for it.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions