Decision needed
Two improve-pipeline features ship default-OFF and have never demonstrated value in prod. Decide per feature: prove it (turn on, measure) or remove the dormant code. Don't carry unproven, switched-off machinery indefinitely.
In scope
How to decide (don't guess — measure)
For each: either (a) enable in a shadow/eval window and measure accepted-change-rate / coverage (NOT promotion volume — see akm-improve-success-metric), keeping it only if it clears a bar; or (b) remove the dormant code and close the feature. Default-off code is cheap to keep but costs clarity and invites half-finished follow-ups (#634).
Acceptance
Relates to #615, #634, #641. Context: akm-recombine-procedural-noise, akm-verify-impact-against-artifacts, akm-improve-success-metric.
Decision needed
Two improve-pipeline features ship default-OFF and have never demonstrated value in prod. Decide per feature: prove it (turn on, measure) or remove the dormant code. Don't carry unproven, switched-off machinery indefinitely.
In scope
src/commands/improve/procedural.ts, default-off viaimprove-profiles.ts). Known to over-fit one-off single-project sequences; procedural: over-fits one-off single-project sequences (recurrence needs cross-project + identifier abstraction + generalizability gate) #634 tracks the (M–L) fix for that. So the real question is upstream: is procedural worth the investment at all, or should feat(improve): procedural compilation from successful sequences #615's code + procedural: over-fits one-off single-project sequences (recurrence needs cross-project + identifier abstraction + generalizability gate) #634 be cut?src/commands/improve/triage.ts, opt-in / default-off). Its own body calls it the lowest-confidence lever, highest false-negative risk; the big cost mass was the (reverted) review-subagent origin filter.How to decide (don't guess — measure)
For each: either (a) enable in a shadow/eval window and measure accepted-change-rate / coverage (NOT promotion volume — see
akm-improve-success-metric), keeping it only if it clears a bar; or (b) remove the dormant code and close the feature. Default-off code is cheap to keep but costs clarity and invites half-finished follow-ups (#634).Acceptance
Relates to #615, #634, #641. Context:
akm-recombine-procedural-noise,akm-verify-impact-against-artifacts,akm-improve-success-metric.