Skip to content

Pull requests: pyc96/sglang

New pull request New
27 Open 0 Closed
27 Open 0 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

perf(frozen_kv_mtp): capture the assistant seed step with CUDA graph (+6.8% chat tok/s, +4.4% summ tok/s)
#27 opened May 26, 2026 by pyc96 Owner • Draft
feat(spec-v2): Option-alpha scaffolding -- FROZEN_KV_MTP via EAGLE V2 (experimental, env-gated, NOT yet functional) speculative-decoding
#26 opened May 26, 2026 by pyc96 Owner • Draft
feat(gemma4): FROZEN_KV_MTP spec-v2 worker (functional WIP, perf TODO) blackwell speculative-decoding
#25 opened May 26, 2026 by pyc96 Owner Loading…
feat(gemma4): FROZEN_KV_MTP spec-v2 scaffolding (env knob + dispatch + plan) blackwell speculative-decoding
#24 opened May 26, 2026 by pyc96 Owner Loading…
feat(spec-v2): Frozen-KV MTP overlap-scheduling worker (experimental opt-in) + V1 None-safety fixes speculative-decoding
#23 opened May 26, 2026 by pyc96 Owner • Draft
fix(gemma4): FROZEN_KV_MTP zero-accept crash + scheduler merge/filter guard blackwell speculative-decoding
#22 opened May 25, 2026 by pyc96 Owner Loading…
perf(gemma4): ULTIMATE v2 -- ties or beats vLLM no-MTP on 3 models (31B-it, 26B-A4B, E4B), MMLU tied blackwell jit-kernel
#21 opened May 25, 2026 by pyc96 Owner • Draft
feat(gemma4 ARF): wire FlashInfer AR+RMSNorm into post-attention site (PR-B/2)
#20 opened May 25, 2026 by pyc96 Owner • Draft
feat(gemma4 ARF): infrastructure - wrapper + Gemma3MLP skip_all_reduce + auto-enable (PR-A/2)
#19 opened May 25, 2026 by pyc96 Owner • Draft
perf(gemma4): ultimate composed branch — beats vLLM on every workload blackwell
#18 opened May 25, 2026 by pyc96 Owner Loading…
perf(gemma4 31b): cap chunked_prefill_size=4096 + bump mem_fraction floor to 0.88 (dense)
#17 opened May 25, 2026 by pyc96 Owner • Draft
perf(gemma4): close triton-attn TPOT gap (fused PLE tail + piecewise CG opt-in) blackwell
#16 opened May 24, 2026 by pyc96 Owner Loading…
feat(yoco): YOCO × frozen-KV MTP interaction bench on E4B-it (PR-D) documentation Improvements or additions to documentation
#15 opened May 24, 2026 by pyc96 Owner • Draft
perf(gemma4): YOCO fast-prefill for E2B/E4B (port of vllm-project/vllm#22628 + #38879) blackwell
#14 opened May 24, 2026 by pyc96 Owner Loading…
feat(yoco): E4B-it H100 bench results + per-prompt parity (PR-C/3) documentation Improvements or additions to documentation
#13 opened May 24, 2026 by pyc96 Owner • Draft
feat(yoco): implement YOCO fast-prefill branch in Gemma4TextModel (PR-B/3)
#12 opened May 24, 2026 by pyc96 Owner • Draft
feat(yoco): add --kv-sharing-fast-prefill server arg + validators (PR-A/3)
#11 opened May 24, 2026 by pyc96 Owner • Draft
perf(gemma4): add Gemma4ForConditionalGeneration to mm_disabled_models blackwell jit-kernel
#10 opened May 24, 2026 by pyc96 Owner • Draft
perf(gemma4 MM): batch vision encoder and embed_vision calls (port of vllm-project/vllm#43169) blackwell
#9 opened May 23, 2026 by pyc96 Owner Loading…
fix(gemma4): only apply swa_full_tokens_ratio=0.15 to MoE variants
#8 opened May 23, 2026 by pyc96 Owner Loading…
Revert "fix(trtllm_mha): clamp page_table to k_cache page range" blackwell
#7 opened May 23, 2026 by pyc96 Owner Loading…
fix(trtllm_mha + FROZEN_KV_MTP): swap SWA-aware state with target pool blackwell
#6 opened May 23, 2026 by pyc96 Owner Loading…
fix(trtllm_mha): clamp page_table to k_cache page range to prevent SWA crash blackwell
#5 opened May 23, 2026 by pyc96 Owner Loading…
perf(gemma4 MTP H100): tune Triton extend tile for Lq=256 / sm_90 jit-kernel
#4 opened May 23, 2026 by pyc96 Owner • Draft
debug: trtllm_mha page_table bounds-check (SGLANG_TRTLLM_MHA_DEBUG=1) blackwell
#3 opened May 23, 2026 by pyc96 Owner Loading…
ProTip! Add no:assignee to see everything that’s not assigned.