Skip to content

perf(cuda): head_dim-128 arm for the warp-split-KV decode kernel, gated OFF (#382) - #425

Merged
localai-bot merged 4 commits into
mainfrom
row/KERNEL-ATTN-DECODE-D128
Aug 11, 2026
Merged

perf(cuda): head_dim-128 arm for the warp-split-KV decode kernel, gated OFF (#382)#425
localai-bot merged 4 commits into
mainfrom
row/KERNEL-ATTN-DECODE-D128