Skip to content

perf(frozen_kv_mtp): capture the assistant seed step with CUDA graph (+6.8% chat tok/s, +4.4% summ tok/s) - #27

Draft
pyc96 wants to merge 1 commit into
pyc/feat-gemma4-ultimate-v2from
pyc/feat-gemma4-mtp-seed-cuda-graph
Draft

perf(frozen_kv_mtp): capture the assistant seed step with CUDA graph (+6.8% chat tok/s, +4.4% summ tok/s)#27
pyc96 wants to merge 1 commit into
pyc/feat-gemma4-ultimate-v2from
pyc/feat-gemma4-mtp-seed-cuda-graph

perf(frozen_kv_mtp): capture the assistant seed step with CUDA graph

d63e4e9
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 warning
update-pr-body
succeeded May 26, 2026 in 4s