Recommend the Cantor-preserving operating point - #17
Draft
Al-does wants to merge 2 commits into
Draft
Conversation
The mixed-state set is the attractor of one contractive map per token, so disjoint first-level images need a contraction ratio below 1/sqrt(3), which puts at least two thirds of belief variance between the branches. That between-branch variance is exactly what a probe on the last token reads, so visible gaps and a low global-R2 floor are the same quantity with opposite signs. Measured across alpha 0.85 to 0.55 the box dimension runs 0.93 to 1.68 while the last-token floor runs 0.80 to 0.26. stay carries no such cost: at fixed alpha, 0.90 to 0.95 leaves the box dimension at 0.93 to 0.85 while accuracy resolution goes from 6 to 21 sigma. cantor_sharp takes that for free at the shipped alpha; cantor drops alpha to 0.75, the widest global-R2 band still showing visible level-one gaps. fractal_preserving_validation reuses the same head-to-head so all four points land in one synthesis. Co-authored-by: Alex Vardakostas <Al-does@users.noreply.github.com>
Validating the two fractal-preserving points changes the recommendation. cantor (stay=0.95, alpha=0.75) keeps visible level-one gaps at box dimension 1.22 and is the only point where the three conditions order cleanly with non-overlapping error bars on the metric whose floor is zero by construction: untrained 0.300 < PPO 0.601 +/- 0.076 < IQN 0.896 +/- 0.005. It also has the lowest IQN seed spread of the four, 2.4x the global-R2 band, and 4.1x the accuracy resolution. cantor_sharp leaves alpha untouched, so the picture is unchanged, and still moves PPO from 0% to 41% of the accuracy range. proposed keeps the widest global-R2 band but its mixed-state set is a dense triangle, its PPO seed spread is the worst of the four, and it is the most compressed on the within-branch metric -- because a smooth belief is something a random causal filter already tracks. Co-authored-by: Alex Vardakostas <Al-does@users.noreply.github.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Stacked on #16, which traded the fractal away for global-R² headroom. That was the wrong trade, and this PR supersedes its recommendation.
Why less visible structure looked like more sensitivity
The two things are the same number. The mixed-state set is the attractor of an iterated function system with one contractive map per token. Disjoint first-level images need a contraction ratio below
1/sqrt(3), which puts at least two thirds of belief variance between the branches — and between-branch variance is exactly what a rank-2 probe on the last token reads.alphaatstay=0.95So a low global-R² floor requires closing the gaps.
staycarries no such cost: it moves the accuracy axis while leaving the geometry alone.Mixed-state geometry at four operating points
Recommendation:
stay = 0.95,alpha = 0.75Four points, matched PPO and IQN arms, three seeds, 2.5M steps, identical recipe and probe.
All four operating points on three axes
stay/alphacantoris the only point where the three conditions order cleanly with non-overlapping error bars on the metric that has a floor of zero by construction: untrained 0.300 < PPO 0.601 ± 0.076 < IQN 0.896 ± 0.005. It also has the lowest IQN seed spread of the four, keeps visible level-one gaps at box dimension 1.22, and takes 2.4× the global-R² band and 4.1× the accuracy resolution of the shipped point.cantor_sharpis the zero-risk option:alphais untouched so the picture is identical in character, and PPO still moves from 0% to 41% of the accuracy range.The deeper fix is the metric
Nearly all of a Cantor-structured belief's variance is which cluster you are in, which the last token already gives away.
conditional_residual_r2at depth two discards exactly that term, so any depth-two token model scores zero there by construction at every operating point. That is why the sparse points still discriminate well on it while their global-R² bands look hopeless — and whyproposed, with the widest global band, is the most compressed on it: a smooth belief is something a random causal filter already tracks (untrained scores 0.715 there).Reward-only PPO fails to clear the global-R² floor at all four points, so that finding is not an artifact of a badly chosen process.
Cost
One RTX 4090 for ~1.2 h, destroyed on completion; no instances remain.
To show artifacts inline, enable in settings.