Skip to content

Add frozen transformer next-token probes for cycle 5 - #37

Draft
Al-does wants to merge 5 commits into
mainfrom
cursor/cycle5-next-token-probe-5467
Draft

Add frozen transformer next-token probes for cycle 5#37
Al-does wants to merge 5 commits into
mainfrom
cursor/cycle5-next-token-probe-5467

Conversation

@Al-does

@Al-does Al-does commented Jul 30, 2026

Copy link
Copy Markdown
Owner

Summary

  • restore all variant-1 cycle-5 checkpoints from their pre-rename B2 artifact prefix, including a compatibility shim for the legacy task path
  • restore only the local RLModule for inference, avoiding the saved distributed training topology and its Ray worker resource demands
  • train stop-gradient transformer probes at context lengths 1 and 10, with and without the selected action
  • optimize exact next-token soft cross-entropy and report forward KL, sampled-token metrics, and joins to the existing affine belief MSE
  • add cross-seed correlation/plot tooling and focused unit coverage, including the optimizer loop

Test plan

  • uv run pytest -q tests/test_cycle5_next_token_probe.py
  • cycle-5 next-token probe smoke run against the B2 initial checkpoint
  • uv run pytest -q -m "not slow"
Open in Web Open in Cursor 

cursoragent and others added 5 commits July 30, 2026 18:17
Co-authored-by: Alex Vardakostas <Al-does@users.noreply.github.com>
Co-authored-by: Alex Vardakostas <Al-does@users.noreply.github.com>
Co-authored-by: Alex Vardakostas <Al-does@users.noreply.github.com>
Co-authored-by: Alex Vardakostas <Al-does@users.noreply.github.com>
Co-authored-by: Alex Vardakostas <Al-does@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants