Skip to content

Record RTX 4090 action-norm performance profile - #3

Draft
Al-does wants to merge 1 commit into
mainfrom
cursor/profile-action-norm-1446
Draft

Record RTX 4090 action-norm performance profile#3
Al-does wants to merge 1 commit into
mainfrom
cursor/profile-action-norm-1446

Conversation

@Al-does

@Al-does Al-does commented Jul 20, 2026

Copy link
Copy Markdown
Owner

Summary

  • record a controlled Vast RTX 4090 baseline for the action-norm experiment
  • document the measured bottlenecks and every tested configuration ablation
  • record the matched end-to-end delta from the promoted RL-Harness hot-path optimizations
  • retain quality evidence for rejecting the faster three-epoch PPO schedule

Results

  • environment microbenchmark: 8.167 s → 5.510 s per 100k steps (-32.5%)
  • matched PPO throughput: 12,537 → 13,049 env steps/s (+4.08%)
  • matched PPO iteration wall time: 5.255 s → 5.048 s (-3.93%)
  • matched seeded reward/KL/loss/value metrics remained identical

Dependency

The promoted implementation is on Al-does/RL-Harness branch cursor/optimize-transition-validation-1446 (commits 740c761 and 1ba1ee3).

Open in Web Open in Cursor 

Co-authored-by: Alex Vardakostas <Al-does@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants