Skip to content

⚠️ Upstream sync blocked — 559 commits, merge conflicts #104

Description

@github-actions

Upstream Sync Failed

Commits behind: 559
Risk level: high

Protected fork files touched upstream

.claude/MEMORY.md
.claude/commands/engram-feature.md
.claude/commands/engram-gate.md
.claude/commands/engram-hooks-off.md
.claude/commands/engram-hooks-on.md
.claude/commands/engram-merge-runbook.md
.claude/commands/engram-pr.md
.claude/commands/engram-runbook.md
.claude/commands/engram-status.md
.claude/skills/add-jit-kernel/SKILL.md
.claude/skills/add-sgl-kernel/SKILL.md
.claude/skills/ci-workflow-guide/SKILL.md
.claude/skills/clean-startup-log/SKILL.md
.claude/skills/debug-cuda-crash/SKILL.md
.claude/skills/engram-brief-contract/SKILL.md
.claude/skills/engram-sglang/SKILL.md
.claude/skills/engram-sglang/references/deployment.md
.claude/skills/engram-sglang/references/radix-attention.md
.claude/skills/engram-sglang/references/structured-generation.md
.claude/skills/env-var-conventions/SKILL.md
.claude/skills/generate-profile/SKILL.md
.claude/skills/large-class-init-style/SKILL.md
.claude/skills/sglang-bisect-ci-regression/SKILL.md
.claude/skills/sglang-cherrypick/SKILL.md
.claude/skills/speculative-naming/SKILL.md
.claude/skills/write-sglang-test/SKILL.md
.devin/wiki.json
.engram/SYNC_PLAYBOOK.md
.engram/hooks/README.md
.engram/hooks/pre-push
.engram/hooks/start-feature.sh
.engram/manifest.md
.engram/policy/protected-paths.json
.github/FUNDING.yml
.github/workflows/amd-aiter-scout.yml
.github/workflows/amd-ci-job-monitor.yml
.github/workflows/auto-tune.yml
.github/workflows/bot-bump-flashinfer-version.yml
.github/workflows/bot-bump-kernel-version-to-sglang.yml
.github/workflows/bot-bump-kernel-version.yml
.github/workflows/bot-bump-sglang-version.yml
.github/workflows/cancel-unfinished-pr-tests.yml
.github/workflows/ci-coverage-overview.yml
.github/workflows/ci-failure-monitor.yml
.github/workflows/list-active-pr-runs.yml
.github/workflows/nightly-release-gateway.yml
.github/workflows/nightly-test-amd-rocm720.yml
.github/workflows/nightly-test-amd.yml
.github/workflows/nightly-test-musa.yml
.github/workflows/nightly-test-npu.yml
.github/workflows/nightly-test-nvidia.yml
.github/workflows/open-pr-copy-from-oss.yml
.github/workflows/open-pr-copy-to-oss.yml
.github/workflows/pr-benchmark-rust.yml
.github/workflows/pr-test-amd-rocm720.yml
.github/workflows/pr-test-amd.yml
.github/workflows/pr-test-extra.yml
.github/workflows/pr-test-jit-kernel.yml
.github/workflows/pr-test-multimodal-gen.yml
.github/workflows/pr-test-musa.yml
.github/workflows/pr-test-npu.yml
.github/workflows/pr-test-rust.yml
.github/workflows/pr-test-sgl-kernel.yml
.github/workflows/pr-test-sgl-router.yml
.github/workflows/pr-test-xeon.yml
.github/workflows/pr-test-xpu.yml
.github/workflows/pr-test.yml
.github/workflows/release-branch-cut.yml
.github/workflows/release-docker-amd-nightly.yml
.github/workflows/release-docker-intel-xpu-nightly.yml
.github/workflows/release-docker-npu-nightly.yml
.github/workflows/release-docker-npu.yml
.github/workflows/release-pypi-gateway.yml
.github/workflows/release-pypi-nightly.yml
.github/workflows/release-pypi-pr.yml
.github/workflows/release-whl-deepgemm.yml
.github/workflows/release-whl-kernel.yml
.github/workflows/runner-utilization.yml
.github/workflows/slash-command-handler.yml
.github/workflows/upstream-sync.yml
.gitignore
.husky/pre-push
.pre-commit-config.yaml
.well-known/ai-manifest
.well-known/funding-manifest-urls
AGENTS.md
CLAUDE.md
NEMOTRON3_SUPER_RESULTS.md
QWEN3_CODER_NEXT_RESULTS.md
README.md
SECURITY.md
assets/engram-logo-banner.png
assets/engram-logo-square.png
benchmark/hicache/bench_multiturn.py
docs/WIKI.md
docs/benchmarks/kha-301-multitenant-concurrency.md
docs/benchmarks/kha-371-snapshot-save-latency.md
docs/benchmarks/kha-393-attention-position-audit.md
docs/migration-prep/BOOTSTRAP_FRESH_VM.md
docs/migration-prep/HANDOFF_2026_03_28.md
docs/migration-prep/NEW_VM_SETUP.md
docs/migration-prep/REMOTE_AGENT_BOOTSTRAP.md
docs/migration-prep/UPSTREAM_SYNC_REPORT.md
docs/migration-prep/UPSTREAM_SYNC_REVIEW_PROMPT.md
docs/migration-prep/claude-code-chat-transcript-93-29-26.md
docs/migration-prep/clean_profile
docs/migration-prep/memory/MEMORY.md
docs/migration-prep/memory/feedback_mamba-test-gotchas.md
docs/migration-prep/memory/project_gap-fixes.md
docs/migration-prep/memory/project_pr4-merged.md
docs/migration-prep/memory/project_sglang-mamba.md
docs/migration-prep/memory/project_test-phase-status.md
docs/migration-prep/memory/user_bbrenner.md
docs/migration-prep/now.md
docs/migration-prep/pull_from_runpod.sh
docs/migration-prep/settings.json
docs/migration-prep/today-2026-03-28.md
docs/migration-prep/vultr_startup.sh
docs/references/production_request_trace.md
docs/requirements.txt
docs/stateful_mamba/.archive/AGENTS.md
docs/stateful_mamba/.archive/DOCSTRING_TEMPLATES.md
docs/stateful_mamba/.archive/api_reference.md
docs/stateful_mamba/.tree.txt
docs/stateful_mamba/INDEX.md
docs/stateful_mamba/SUMMARY.md
docs/stateful_mamba/api_guide.md
docs/stateful_mamba/architecture.md
docs/stateful_mamba/examples.md
docs/stateful_mamba/http_api_spec.md
docs/stateful_mamba/kha-387-runs-2026-05-21/per-case.log
docs/stateful_mamba/kha-387-runs-2026-05-21/report.md
docs/stateful_mamba/kha-387-runs-2026-05-21/results.json
docs/stateful_mamba/kha-387-runs-2026-05-21/server-restore-evidence.log
docs/stateful_mamba/kha-387-ssm-ablation-methodology.md
docs/stateful_mamba/kha-387-ssm-ablation-results-2026-05-21.md
docs/stateful_mamba/migration_guide.md
docs/stateful_mamba/state_validation.md
docs/stateful_mamba/troubleshooting.md
docs/stateful_mamba/user_guide.md
docs/upstream-sync/scheduler-decomposition-port.md
docs/wiki-pages/Agent-Framework.md
docs/wiki-pages/Phase-3-Audit-Archive.md
docs/wiki-pages/Project-Reports-Archive.md
docs/wiki-pages/Pure-Mamba2-Support.md
docs/wiki-pages/Stateful-Mamba-Guide.md
docs/wiki-pages/Upstream-Sync-Q1-2026.md
docs_new/index.mdx
engram.json
funding.json
python/pyproject.toml
python/sglang/__init__.py
python/sglang/_triton_stub.py
python/sglang/jit_kernel/fused_metadata_copy.py
python/sglang/lang/backend/runtime_endpoint.py
python/sglang/lang/interpreter.py
python/sglang/snapshot.py
python/sglang/srt/agents/__init__.py
python/sglang/srt/agents/agent_loop.py
python/sglang/srt/agents/api/__init__.py
python/sglang/srt/agents/api/handlers.py
python/sglang/srt/agents/api/models.py
python/sglang/srt/agents/api/websocket.py
python/sglang/srt/agents/builtin_tools.py
python/sglang/srt/agents/tool_execution.py
python/sglang/srt/agents/tool_parser.py
python/sglang/srt/agents/tool_registry.py
python/sglang/srt/configs/__init__.py
python/sglang/srt/configs/mamba2.py
python/sglang/srt/configs/model_config.py
python/sglang/srt/entrypoints/http_server.py
python/sglang/srt/entrypoints/openai/protocol.py
python/sglang/srt/entrypoints/openai/serving_chat.py
python/sglang/srt/entrypoints/openai/serving_completions.py
python/sglang/srt/layers/attention/mamba/mamba2_metadata.py
python/sglang/srt/managers/io_struct.py
python/sglang/srt/managers/schedule_batch.py
python/sglang/srt/managers/scheduler.py
python/sglang/srt/managers/scheduler_agent_system.py
python/sglang/srt/managers/scheduler_components/batch_result_processor.py
python/sglang/srt/managers/scheduler_components/output_streamer.py
python/sglang/srt/managers/scheduler_pending_restore.py
python/sglang/srt/managers/scheduler_snapshot_handlers.py
python/sglang/srt/managers/scheduler_snapshot_system.py
python/sglang/srt/managers/tokenizer_manager.py
python/sglang/srt/mem_cache/mamba_radix_cache.py
python/sglang/srt/mem_cache/memory_pool.py
python/sglang/srt/model_executor/forward_batch_info.py
python/sglang/srt/model_executor/model_runner.py
python/sglang/srt/model_executor/pool_configurator.py
python/sglang/srt/models/mamba2.py
python/sglang/srt/models/nemotron_h.py
python/sglang/srt/observability/metrics_collector.py
python/sglang/srt/observability/mooncake_trace.py
python/sglang/srt/observability/req_time_stats.py
python/sglang/srt/observability/trace.py
python/sglang/srt/server_args.py
python/sglang/srt/snapshot/__init__.py
python/sglang/srt/snapshot/conversation_tracker.py
python/sglang/srt/snapshot/mamba_host_pool.py
python/sglang/srt/snapshot/mamba_snapshot.py
python/sglang/srt/snapshot/snapshot_hooks.py
python/sglang/srt/snapshot/snapshot_policy.py
python/sglang/srt/snapshot/state_health.py
python/sglang/srt/snapshot/tier_manager.py
python/sglang/srt/utils/common.py
python/sglang/srt/utils/hf_transformers/common.py
python/sglang/srt/utils/hf_transformers/config.py
python/sglang/srt/utils/hf_transformers/tokenizer.py
python/sglang/srt/utils/network.py
python/sglang/test/run_eval.py
python/sglang/test/srt/layers/mamba/__init__.py
python/sglang/test/srt/layers/mamba/conftest.py
python/sglang/test/srt/test_pending_restore_registry.py
python/sglang/test/srt/test_snapshot_validation.py
python/sglang/test/srt/test_startup_snapshot_restore.py
python/sglang/test/srt/test_state_health.py
scripts/ci/utils/diffusion/generate_diffusion_dashboard.py
scripts/ci/utils/slash_command_handler.py
scripts/kha-387-ssm-ablation.py
scripts/kha-387-ssm-ablation.sh
scripts/kha-394-ttft-amortization.py
scripts/policy/check_protected_paths.py
scripts/validate-sync.sh
scripts/validate_funding_json.py
scripts/validation/multitenant_concurrency.py
sgl-kernel/benchmark/bench_fp4_gemm.py
sgl-kernel/python/sgl_kernel/flash_mla.py
sgl-model-gateway/bindings/golang/examples/oai_server/go.mod
sgl-model-gateway/bindings/golang/examples/oai_server/go.sum
sgl-model-gateway/bindings/golang/go.mod
sgl-model-gateway/bindings/golang/go.sum
test/manual/test_sglang_auto_benchmark_skill_configs.py
test/manual/test_streaming_session_leak.py
test/phases/BOOTSTRAP_FRESH_VM.md
test/phases/MODEL_COMPAT_PROTOCOL.md
test/phases/MODEL_MATRIX.md
test/phases/NEW_VM_SETUP.md
test/phases/README.md
test/phases/codemap.md
test/phases/config.sh
test/phases/phase-00-environment-verification.md
test/phases/phase-01-stateless-inference-baseline.md
test/phases/phase-02-mamba-pool-unit-tests.md
test/phases/phase-03-mamba-radix-cache-component-tests.md
test/phases/phase-04-live-server-integration-no-buffer.md
test/phases/phase-05-mamba2metadata-integrity.md
test/phases/phase-06-extra-buffer-strategy.md
test/phases/phase-07-snapshot-system.md
test/phases/phase-08-true-stateful-inference.md
test/phases/phase-09-gauntlet-stress-tests.md
test/phases/phase-11a-codestral-mamba-7b.md
test/phases/results/INDEX.md
test/phases/results/compat-granite-4.0-h-small-20260401.md
test/phases/results/compat-nemotron-3-super-120b-fp8-20260401.md
test/phases/results/compat-qwen3-coder-next-fp8-2026-04-01.md
test/phases/results/fix-restore-snapshot-stateful-gen-20260401.md
test/phases/results/kha-394-h100-20260521.json
test/phases/results/kha-394-h100-20260521.md
test/phases/results/phase-00-granite-4.0-h-tiny-20260324.md
test/phases/results/phase-01-granite-4.0-h-tiny-20260329-0237.md
test/phases/results/phase-02-granite-4.0-h-tiny-20260324-0503.md
test/phases/results/phase-03-granite-4.0-h-tiny-20260324-0507.md
test/phases/results/phase-03-granite-4.0-h-tiny-20260328-0917.md
test/phases/results/phase-03-upstream-sync-2026-03-31.md
test/phases/results/phase-04-granite-4.0-h-tiny-20260329-0318.md
test/phases/results/phase-04-upstream-sync-2026-03-31.md
test/phases/results/phase-05-granite-4.0-h-tiny-20260324-0509.md
test/phases/results/phase-05-upstream-sync-2026-03-31.md
test/phases/results/phase-06-results.md
test/phases/results/phase-06-upstream-sync-2026-03-31.md
test/phases/results/phase-06b-upstream-sync-2026-03-31.md
test/phases/results/phase-07-granite-4.0-h-tiny-20260329.md
test/phases/results/phase-07-upstream-sync-2026-03-31.md
test/phases/results/phase-08-results.md
test/phases/results/phase-08-upstream-sync-validation-2026-03-31.md
test/phases/results/phase-09-results.md
test/phases/results/phase-10-context-scaling-multi-turn.json
test/phases/results/phase-10-context-scaling-results.md
test/phases/results/phase-10-context-scaling-single-shot.json
test/phases/results/phase-10-final-report.md
test/phases/results/phase-10-h-small-results.md
test/phases/results/phase-10-nemotron-results.md
test/phases/results/phase-10-resilience-results.json
test/phases/results/phase-10-resilience-results.md
test/phases/results/phase-10-results.md
test/phases/results/stateful-recall-rerun-20260401.md
test/phases/scripts/download-model.sh
test/phases/scripts/phase-10-context-scaling.py
test/phases/scripts/phase-10-h-small-test.py
test/phases/scripts/phase-10-resilience.py
test/phases/scripts/phase-10-scaling.py
test/registered/4-gpu-models/test_qwen35_fp4_mtp_v2.py
test/registered/4-gpu-models/test_qwen35_models.py
test/registered/8-gpu-models/test_deepseek_v3_mtp.py
test/registered/8-gpu-models/test_ling_2_6_flash.py
test/registered/amd/accuracy/mi35x/test_deepseek_r1_eval_mi35x.py
test/registered/amd/accuracy/mi35x/test_deepseek_r1_mxfp4_ar_fusion_eval_mi35x.py
test/registered/amd/accuracy/mi35x/test_deepseek_r1_mxfp4_eval_mi35x.py
test/registered/amd/accuracy/mi35x/test_deepseek_r1_mxfp4_kv_fp8_eval_mi35x.py
test/registered/amd/accuracy/mi35x/test_deepseek_r1_mxfp4_tp2_mi35x.py
test/registered/amd/accuracy/mi35x/test_deepseek_r1_mxfp4_tp4_mi35x.py
test/registered/amd/accuracy/mi35x/test_deepseek_v32_dp_eval_mi35x.py
test/registered/amd/accuracy/mi35x/test_deepseek_v32_eval_mi35x.py
test/registered/amd/accuracy/mi35x/test_deepseek_v32_mtp_eval_mi35x.py
test/registered/amd/accuracy/mi35x/test_glm47_fp8_eval_mi35x.py
test/registered/amd/accuracy/mi35x/test_glm51_eval_mi35x.py
test/registered/amd/accuracy/mi35x/test_glm51_mxfp4_tp2_gsm8k_mi35x.py
test/registered/amd/accuracy/mi35x/test_glm5_eval_mi35x.py
test/registered/amd/accuracy/mi35x/test_glm5_mxfp4_eval_mi35x.py
test/registered/amd/accuracy/mi35x/test_gpt_oss_eval_mi35x.py
test/registered/amd/accuracy/mi35x/test_kimi_k25_aiter_mla_eval_mi35x.py
test/registered/amd/accuracy/mi35x/test_kimi_k25_mxfp4_eval_mi35x.py
test/registered/amd/accuracy/mi35x/test_minimax_m25_eval_mi35x.py
test/registered/amd/accuracy/mi35x/test_minimax_m25_tp4_eval_mi35x.py
test/registered/amd/accuracy/mi35x/test_minimax_m27_eval_mi35x.py
test/registered/amd/accuracy/mi35x/test_qwen3_coder_next_eval_mi35x.py
test/registered/amd/disaggregation/test_mori_transfer_engine_e2e.py
test/registered/amd/perf/mi35x/test_deepseek_r1_mxfp4_ar_fusion_perf_mi35x.py
test/registered/amd/perf/mi35x/test_deepseek_r1_mxfp4_kv_fp8_perf_mi35x.py
test/registered/amd/perf/mi35x/test_deepseek_r1_mxfp4_perf_mi35x.py
test/registered/amd/perf/mi35x/test_glm51_perf_mi35x.py
test/registered/amd/perf/mi35x/test_glm5_mxfp4_perf_mi35x.py
test/registered/amd/perf/mi35x/test_glm5_perf_mi35x.py
test/registered/amd/perf/mi35x/test_kimi_k26_perf_mi35x.py
test/registered/amd/perf/mi35x/test_minimax_m25_perf_mi35x.py
test/registered/amd/perf/mi35x/test_minimax_m27_perf_mi35x.py
test/registered/amd/perf/mi35x/test_qwen35_fp8_perf_mi35x.py
test/registered/amd/test_deepseek_r1_hicache_mi35x.py
test/registered/amd/test_deepseek_r1_mxfp4_8gpu.py
test/registered/amd/test_deepseek_v4_flash_fp4.py
test/registered/amd/test_deepseek_v4_flash_fp8.py
test/registered/amd/test_deepseek_v4_pro_fp4.py
test/registered/amd/test_deepseek_v4_pro_fp8.py
test/registered/amd/test_kimi_k2_instruct.py
test/registered/ascend/basic_function/HiCache/test_npu_hierarchical_cache_mla.py
test/registered/ascend/basic_function/HiCache/test_npu_hierarchical_cache_ttft_mha.py
test/registered/ascend/basic_function/memory_and_scheduling/test_npu_no_chunked_prefill.py
test/registered/ascend/basic_function/parallel_strategy/expert_parallelism/test_npu_deepep.py
test/registered/ascend/basic_function/parallel_strategy/expert_parallelism/test_npu_deepep_auto_qwen3_480b.py
test/registered/ascend/basic_function/parallel_strategy/expert_parallelism/test_npu_deepep_auto_qwen3_next.py
test/registered/ascend/basic_function/parallel_strategy/expert_parallelism/test_npu_deepep_low_latency_qwen3_next.py
test/registered/ascend/basic_function/parameter/test_npu_fim_completion.py
test/registered/ascend/basic_function/parameter/test_npu_no_chunked_prefill.py
test/registered/ascend/basic_function/parameter/test_npu_no_overlap_scheduler.py
test/registered/ascend/basic_function/parameter/test_npu_warmups.py
test/registered/ascend/interface/test_npu_enable_thinking.py
test/registered/ascend/interface/test_npu_openai_function_calling.py
test/registered/ascend/llm_models/test_ascend_minimax_m2.py
test/registered/ascend/llm_models/test_npu_llama4_scount_17b_16e.py
test/registered/ascend/llm_models/test_npu_minicpm3_4b.py
test/registered/ascend/vlm_models/test_npu_deepseek_vl2.py
test/registered/ascend/vlm_models/test_npu_kimi_vl_a3b_instruct.py
test/registered/ascend/vlm_models/test_npu_llama_3_2_11b_vision_instruct.py
test/registered/ascend/vlm_models/test_npu_minicpm_o_2_6.py
test/registered/attention/test_chunk_gated_delta_rule.py
test/registered/attention/test_gdn_prefill_cutedsl.py
test/registered/attention/test_kda_kernels.py
test/registered/attention/unittests/KNOWN_FAILURES.md
test/registered/attention/unittests/__init__.py
test/registered/attention/unittests/conftest.py
test/registered/attention/unittests/dense/README.md
test/registered/attention/unittests/dense/__init__.py
test/registered/attention/unittests/dense/test_extend_init_contract.py
test/registered/attention/unittests/dense/test_fa3.py
test/registered/attention/unittests/dense/test_fa4.py
test/registered/attention/unittests/dense/test_flashinfer.py
test/registered/attention/unittests/dense/test_flex_attention.py
test/registered/attention/unittests/dense/test_hybrid_attn.py
test/registered/attention/unittests/dense/test_tbo.py
test/registered/attention/unittests/dense/test_torch_native.py
test/registered/attention/unittests/dense/test_triton.py
test/registered/attention/unittests/dense/test_trtllm_mha.py
test/registered/attention/unittests/dsa/README.md
test/registered/attention/unittests/dsa/__init__.py
test/registered/attention/unittests/dsa/test_dsa.py
test/registered/attention/unittests/dsv4/README.md
test/registered/attention/unittests/dsv4/__init__.py
test/registered/attention/unittests/dsv4/test_deepseek_v4.py
test/registered/attention/unittests/dual_chunk/README.md
test/registered/attention/unittests/dual_chunk/__init__.py
test/registered/attention/unittests/dual_chunk/test_dual_chunk_flash_attn.py
test/registered/attention/unittests/gdn/README.md
test/registered/attention/unittests/gdn/__init__.py
test/registered/attention/unittests/gdn/test_flashinfer.py
test/registered/attention/unittests/gdn/test_torch_native.py
test/registered/attention/unittests/gdn/test_triton.py
test/registered/attention/unittests/kda/README.md
test/registered/attention/unittests/kda/__init__.py
test/registered/attention/unittests/kda/test_triton.py
test/registered/attention/unittests/lightning/README.md
test/registered/attention/unittests/lightning/__init__.py
test/registered/attention/unittests/lightning/test_triton.py
test/registered/attention/unittests/mamba/README.md
test/registered/attention/unittests/mamba/__init__.py
test/registered/attention/unittests/mamba/test_mamba2.py
test/registered/attention/unittests/mla/README.md
test/registered/attention/unittests/mla/__init__.py
test/registered/attention/unittests/mla/test_cutlass_mla.py
test/registered/attention/unittests/mla/test_flashinfer.py
test/registered/attention/unittests/mla/test_flashmla.py
test/registered/attention/unittests/mla/test_tokenspeed_mla.py
test/registered/attention/unittests/mla/test_triton.py
test/registered/attention/unittests/mla/test_trtllm_mla.py
test/registered/attention/unittests/swa/README.md
test/registered/attention/unittests/swa/__init__.py
test/registered/attention/unittests/swa/test_flashinfer.py
test/registered/attention/unittests/swa/test_torch_native.py
test/registered/attention/unittests/swa/test_triton.py
test/registered/backends/test_flashinfer_fusion_preflight.py
test/registered/backends/test_flashinfer_trtllm_gen_moe_backend.py
test/registered/bench_fn/test_benchmark_datasets_api.py
test/registered/core/test_basic_sanity_eagle3.py
test/registered/core/test_server_args.py
test/registered/core/test_ssl_cert_refresher.py
test/registered/cp/test_deepseek_v3_cp_single_node.py
test/registered/cp/test_deepseek_v4_flash_fp4_b200_cp.py
test/registered/cp/test_qwen3_30b.py
test/registered/cpu/test_decode.py
test/registered/cpu/test_extend.py
test/registered/cpu/test_gemm.py
test/registered/cpu/test_mamba.py
test/registered/cpu/test_mla.py
test/registered/cpu/test_moe.py
test/registered/cpu/test_rope.py
test/registered/cpu/test_server_args_backend.py
test/registered/cpu/test_store_cache.py
test/registered/cpu/test_topk.py
test/registered/cpu/utils.py
test/registered/debug_utils/comparator/aligner/entrypoint/test_executor.py
test/registered/debug_utils/comparator/aligner/entrypoint/test_planner.py
test/registered/debug_utils/comparator/aligner/reorderer/test_executor.py
test/registered/debug_utils/comparator/aligner/reorderer/test_planner.py
test/registered/debug_utils/comparator/aligner/test_axis_aligner.py
test/registered/debug_utils/comparator/aligner/token_aligner/test_aux_plugins.py
test/registered/debug_utils/comparator/aligner/token_aligner/test_concat_steps.py
test/registered/debug_utils/comparator/aligner/token_aligner/test_executor.py
test/registered/debug_utils/comparator/aligner/token_aligner/test_planner.py
test/registered/debug_utils/comparator/aligner/unsharder/test_executor.py
test/registered/debug_utils/comparator/aligner/unsharder/test_parallel_info.py
test/registered/debug_utils/comparator/aligner/unsharder/test_planner.py
test/registered/debug_utils/comparator/dims_spec/test_dim_parser.py
test/registered/debug_utils/comparator/dims_spec/test_dims_parser.py
test/registered/debug_utils/comparator/dims_spec/test_tensor_naming.py
test/registered/debug_utils/comparator/dims_spec/test_types.py
test/registered/debug_utils/comparator/tensor_comparator/test_comparator.py
test/registered/debug_utils/comparator/tensor_comparator/test_types.py
test/registered/debug_utils/comparator/test_log_sink.py
test/registered/debug_utils/comparator/test_meta_overrider.py
test/registered/debug_utils/comparator/test_model_validation.py
test/registered/debug_utils/comparator/test_preset.py
test/registered/debug_utils/comparator/test_utils.py
test/registered/debug_utils/source_patcher/test_code_patcher.py
test/registered/debug_utils/source_patcher/test_dumper_integration.py
test/registered/debug_utils/source_patcher/test_source_editor.py
test/registered/debug_utils/test_crash_dump.py
test/registered/debug_utils/test_engine_dumper_comparator_e2e.py
test/registered/debug_utils/test_schedule_simulator.py
test/registered/debug_utils/test_soft_watchdog.py
test/registered/disaggregation/test_disaggregation_aarch64.py
test/registered/disaggregation/test_disaggregation_basic.py
test/registered/disaggregation/test_disaggregation_decode_radix_cache.py
test/registered/disaggregation/test_disaggregation_different_tp.py
test/registered/disaggregation/test_disaggregation_dp_attention.py
test/registered/disaggregation/test_disaggregation_dsv4.py
test/registered/disaggregation/test_disaggregation_hybrid_attention.py
test/registered/disaggregation/test_disaggregation_optimistic_prefill.py
test/registered/disaggregation/test_disaggregation_pp.py
test/registered/disaggregation/test_epd_disaggregation.py
test/registered/dp_attn/test_dp_attention.py
test/registered/dp_engine/test_data_parallelism.py
test/registered/function_call/test_kimik2_detector.py
test/registered/hicache/test_hicache_spec_file_storage.py
test/registered/hicache/test_hicache_spec_mooncake_storage.py
test/registered/hicache/test_hicache_storage_file_backend.py
test/registered/hicache/test_qwen35_hicache.py
test/registered/kernels/test_cp_prefix_len_fa3_parity.py
test/registered/kernels/test_dsa_indexer.py
test/registered/kernels/test_gemma4_fused_routing.py
test/registered/kernels/test_mla_cp_fa3_parity.py
test/registered/kernels/test_sm120_flash_mla.py
test/registered/kernels/test_sm120_paged_mqa_logits.py
test/registered/kv_canary/test_e2e_base.py
test/registered/kv_canary/test_self_e2e_baseline.py
test/registered/kv_canary/test_self_e2e_bench_speed.py
test/registered/kv_canary/test_self_e2e_pd_baseline.py
test/registered/kv_canary/test_self_e2e_pd_perturb.py
test/registered/kv_canary/test_self_e2e_perturb_raise.py
test/registered/kv_canary/test_self_e2e_perturb_real_kv_unused_cache.py
test/registered/kv_canary/test_self_e2e_perturb_real_kv_used.py
test/registered/kv_canary/test_self_e2e_perturb_req_to_token.py
test/registered/kv_canary/test_self_e2e_pr_25015.py
test/registered/kv_canary/test_self_e2e_pr_26329.py
test/registered/kv_canary/test_self_unit_buffer_alloc.py
test/registered/kv_canary/test_self_unit_capacities.py
test/registered/kv_canary/test_self_unit_e2e_base.py
test/registered/kv_canary/test_self_unit_endpoint.py
test/registered/kv_canary/test_self_unit_future_tensor.py
test/registered/kv_canary/test_self_unit_perturb.py
test/registered/kv_canary/test_self_unit_plan_input.py
test/registered/kv_canary/test_self_unit_pool_patcher.py
test/registered/kv_canary/test_self_unit_pool_patcher_utils.py
test/registered/kv_canary/test_self_unit_radix_walker.py
test/registered/kv_canary/test_self_unit_req_to_expected_token_ids_manager.py
test/registered/kv_canary/test_self_unit_runner_health.py
test/registered/kv_canary/test_self_unit_runner_per_forward.py
test/registered/kv_canary/test_self_unit_runner_swa_divergence.py
test/registered/kv_canary/test_self_unit_runner_sweep.py
test/registered/kv_canary/test_self_unit_sweep_plan_builder.py
test/registered/kv_canary/test_self_unit_token_oracle.py
test/registered/kv_canary/test_self_unit_violation.py
test/registered/lora/test_lora_eviction_policy.py
test/registered/lora/test_lora_openai_api.py
test/registered/lora/test_lora_overlap_loading.py
test/registered/lora/test_moe_lora_info.py
test/registered/mock_model/test_e2e_pd.py
test/registered/mock_model/test_e2e_pp.py
test/registered/mock_model/test_e2e_spec_eagle.py
test/registered/mock_model/test_e2e_tp.py
test/registered/mock_model/test_self_e2e_perturb_next_token_swap.py
test/registered/mock_model/test_self_unit_canary_mock_wiring.py
test/registered/mock_model/test_self_unit_canary_perturb.py
test/registered/mock_model/test_self_unit_install.py
test/registered/mock_model/test_self_unit_oracle.py
test/registered/mock_model/test_self_unit_oracle_torch_vs_ref.py
test/registered/mock_model/test_self_unit_sampler_hookpoint.py
test/registered/model_loading/test_external_models.py
test/registered/model_loading/test_load_weights_from_remote_instance.py
test/registered/model_loading/test_load_weights_from_remote_instance_npu.py
test/registered/models/test_transformers_backend_eval.py
test/registered/models_e2e/test_deepseek_v32_fp4_mtp_dp.py
test/registered/models_e2e/test_deepseek_v32_fp4_mtp_tp.py
test/registered/models_e2e/test_deepseek_v3_fp4.py
test/registered/models_e2e/test_deepseek_v3_mtp.py
test/registered/models_e2e/test_deepseek_v4_flash_fp4_b200.py
test/registered/models_e2e/test_deepseek_v4_flash_fp4_h200.py
test/registered/models_e2e/test_deepseek_v4_flash_fp4_megamoe_b200.py
test/registered/models_e2e/test_deepseek_v4_flash_fp8_h200.py
test/registered/models_e2e/test_gpt_oss_4gpu_bf16.py
test/registered/models_e2e/test_gpt_oss_4gpu_mxfp4.py
test/registered/models_e2e/test_mimo_v2.py
test/registered/models_e2e/test_mimo_v2_flash.py
test/registered/models_e2e/test_minimax_m25_basic.py
test/registered/models_e2e/test_nvidia_nemotron_3_super_bf16.py
test/registered/models_e2e/test_nvidia_nemotron_3_super_bf16_mtp.py
test/registered/models_e2e/test_qwen35_fp4_flashinfer.py
test/registered/models_e2e/test_qwen35_fp4_mtp.py
test/registered/models_e2e/test_qwen3_next_models.py
test/registered/models_e2e/test_qwen3_next_models_mtp.py
test/registered/models_e2e/test_step3p5_flash_chain_mtp.py
test/registered/moe/test_hybrid_dp_ep_tp_mtp.py
test/registered/observability/test_cpu_monitor.py
test/registered/observability/test_metrics.py
test/registered/observability/test_priority_metrics.py
test/registered/observability/test_tracing_disaggregation.py
test/registered/ops/test_aiter_allgather_amd.py
test/registered/ops/test_aiter_greedy_sample_amd.py
test/registered/piecewise_cuda_graph/test_pcg_glm5_fp4.py
test/registered/pp/test_pp_single_node.py
test/registered/pp/test_pp_single_node_extra.py
test/registered/quant/test_deepseek_v32_fp4_mtp_4gpu.py
test/registered/quant/test_deepseek_v3_fp4_4gpu.py
test/registered/quant/test_is_layer_skipped.py
test/registered/quant/test_quant_config_parsing.py
test/registered/quant/test_quark_mxfp4.py
test/registered/radix_cache/test_mamba_baseline_inference.py
test/registered/radix_cache/test_mamba_extra_buffer.py
test/registered/radix_cache/test_mamba_gauntlet_stress.py
test/registered/radix_cache/test_mamba_metadata.py
test/registered/radix_cache/test_mamba_pool_extended.py
test/registered/radix_cache/test_mamba_radix_cache_comprehensive.py
test/registered/radix_cache/test_mamba_radix_cache_gauntlet.py
test/registered/radix_cache/test_mamba_radix_cache_server_integration.py
test/registered/radix_cache/test_mamba_snapshot_e2e.py
test/registered/radix_cache/test_mamba_stateful_inference.py
test/registered/radix_cache/unified_radix_tree/test_unified_radix_cache_kl_cp.py
test/registered/radix_cache/unified_radix_tree/test_unified_radix_cache_kl_dsv4.py
test/registered/radix_cache/unified_radix_tree/test_unified_radix_cache_kl_full.py
test/registered/radix_cache/unified_radix_tree/test_unified_radix_cache_kl_mamba.py
test/registered/radix_cache/unified_radix_tree/test_unified_radix_cache_kl_nightly.py
test/registered/radix_cache/unified_radix_tree/test_unified_radix_cache_kl_swa.py
test/registered/rl/test_pause_generation_tensor_consistency.py
test/registered/rl/test_return_indexer_topk.py
test/registered/rl/test_return_routed_experts.py
test/registered/scheduler/test_abort_with_metrics.py
test/registered/scheduler/test_load_snapshot_server.py
test/registered/scheduler/test_routing_key_scheduling.py
test/registered/sessions/test_session_latency.py
test/registered/spec/dflash/test_dflash.py
test/registered/spec/eagle/test_adaptive_speculative.py
test/registered/spec/eagle/test_deepseek_v3_fp4_mtp_small.py
test/registered/spec/eagle/test_eagle_constrained_decoding.py
test/registered/spec/eagle/test_eagle_dp_attention.py
test/registered/spec/eagle/test_eagle_infer_a.py
test/registered/spec/eagle/test_eagle_infer_b.py
test/registered/spec/eagle/test_eagle_infer_beta.py
test/registered/spec/eagle/test_eagle_infer_beta_dp_attention.py
test/registered/spec/eagle/test_eagle_infer_beta_dp_attention_large.py
test/registered/spec/eagle/test_spec_eagle.py
test/registered/spec/eagle/test_spec_eagle_fa3.py
test/registered/spec/eagle/test_spec_eagle_page.py
test/registered/spec/eagle/test_spec_eagle_parity.py
test/registered/spec/eagle/test_spec_eagle_stress.py
test/registered/spec/eagle/test_spec_eagle_topk.py
test/registered/spec/eagle/test_spec_eagle_triton.py
test/registered/spec/test_constrained_decoding_spec_reasoning.py
test/registered/spec/test_frozen_kv_mtp.py
test/registered/spec/test_gemma4_mtp_26b_a4b_extra.py
test/registered/spec/test_gemma4_mtp_31b_extra.py
test/registered/unit/constrained/test_grammar_manager.py
test/registered/unit/constrained/test_reasoner_grammar_backend.py
test/registered/unit/constrained/test_utils.py
test/registered/unit/disaggregation/test_disaggregation_wire.py
test/registered/unit/disaggregation/test_nixl_sender_failure_cleanup.py
test/registered/unit/distributed/test_parallel_state.py
test/registered/unit/entrypoints/openai/test_protocol.py
test/registered/unit/entrypoints/openai/test_serving_chat.py
test/registered/unit/entrypoints/openai/test_serving_embedding.py
test/registered/unit/entrypoints/openai/test_serving_transcription.py
test/registered/unit/entrypoints/test_server_info.py
test/registered/unit/entrypoints/test_v1_loads_aggregate.py
test/registered/unit/function_call/test_function_call_parser.py
test/registered/unit/function_call/test_json_schema_constraint.py
test/registered/unit/function_call/test_minicpm5_detector.py
test/registered/unit/function_call/test_normalize_json_schema_types.py
test/registered/unit/function_call/test_parallel_tool_calls.py
test/registered/unit/function_call/test_unknown_tool_name.py
test/registered/unit/hardware_backend/mlx/test_attention_patching.py
test/registered/unit/layers/quantization/test_mxfp4_sm90_cutlass.py
test/registered/unit/layers/test_mamba_state_scatter_triton.py
test/registered/unit/lora/test_mem_pool_ep_unit.py
test/registered/unit/managers/test_data_parallel_controller.py
test/registered/unit/managers/test_dp_budget.py
test/registered/unit/managers/test_io_struct.py
test/registered/unit/managers/test_load_snapshot_backends.py
test/registered/unit/managers/test_mm_hashes.py
test/registered/unit/managers/test_multi_tokenizer_mixin.py
test/registered/unit/managers/test_prefill_adder.py
test/registered/unit/managers/test_priority_scheduling_disaggregation.py
test/registered/unit/managers/test_profile_merger_http_api.py
test/registered/unit/managers/test_scheduler_chunked_req_gate.py
test/registered/unit/managers/test_scheduler_flush_cache.py
test/registered/unit/managers/test_scheduler_pause_generation.py
test/registered/unit/managers/test_template_manager.py
test/registered/unit/mem_cache/test_decode_radix_lock_ref.py
test/registered/unit/mem_cache/test_evict_policy.py
test/registered/unit/mem_cache/test_hicache_nixl_storage.py
test/registered/unit/mem_cache/test_hiradix_cache_unit.py
test/registered/unit/mem_cache/test_mamba_unittest.py
test/registered/unit/mem_cache/test_mooncake_standalone_dummy_mamba.py
test/registered/unit/mem_cache/test_radix_cache_slru_accuracy.py
test/registered/unit/mem_cache/test_radix_cache_unit.py
test/registered/unit/mem_cache/test_radix_force_miss.py
test/registered/unit/mem_cache/test_registry.py
test/registered/unit/mem_cache/test_swa_alloc_extend_page_estimation.py
test/registered/unit/mem_cache/test_swa_eviction_boundary.py
test/registered/unit/mem_cache/test_swa_lock_release_lifecycle.py
test/registered/unit/mem_cache/test_swa_unittest.py
test/registered/unit/mem_cache/test_unified_radix_cache_bench.py
test/registered/unit/mem_cache/test_unified_radix_cache_unittest.py
test/registered/unit/mem_cache/test_unified_radix_hicache_dispatch.py
test/registered/unit/model_executor/test_cuda_graph_buffer_registry.py
test/registered/unit/model_loader/test_modelopt_loader.py
test/registered/unit/models/test_llava.py
test/registered/unit/models/test_nemotron_h_weight_loading.py
test/registered/unit/observability/test_cpu_monitor.py
test/registered/unit/observability/test_func_timer.py
test/registered/unit/observability/test_label_transform.py
test/registered/unit/observability/test_metrics_utils.py
test/registered/unit/observability/test_request_metrics_exporter.py
test/registered/unit/observability/test_startup_func_log_and_timer.py
test/registered/unit/observability/test_stat_loggers_di.py
test/registered/unit/observability/test_trace.py
test/registered/unit/parser/test_code_completion_parser.py
test/registered/unit/parser/test_conversation.py
test/registered/unit/parser/test_harmony_parser.py
test/registered/unit/parser/test_jinja_template_utils.py
test/registered/unit/parser/test_reasoning_content_without_parser.py
test/registered/unit/sampling/test_custom_logit_processor.py
test/registered/unit/sampling/test_penaltylib.py
test/registered/unit/sampling/test_sampling_batch_info.py
test/registered/unit/sampling/test_sampling_params.py
test/registered/unit/server_args/test_server_args.py
test/registered/unit/spec/test_adaptive_spec_params.py
test/registered/unit/spec/test_eagle_worker_v2_topk1_fastpath.py
test/registered/unit/test_documentation_pr_changes.py
test/registered/unit/test_mamba_state_scatter_triton.py
test/registered/unit/test_runai_utils.py
test/registered/unit/utils/test_common.py
test/registered/unit/utils/test_field_validators.py
test/registered/unit/utils/test_gauge_histogram.py
test/registered/unit/utils/test_http_server_auth.py
test/registered/unit/utils/test_json_response.py
test/registered/unit/utils/test_patch_tokenizer.py
test/registered/unit/utils/test_profile_merger.py
test/registered/unit/utils/test_subprocess_watchdog.py
test/registered/unit/utils/test_weight_checker.py
test/registered/utils/test_log_utils.py
test/registered/utils/test_model_file_verifier.py
test/registered/utils/test_network_address.py
test/registered/utils/test_phase_checker.py
test/registered/utils/test_socket_utils.py
test/registered/utils/test_type_based_dispatcher.py
test/registered/vlm/test_evs.py
test/registered/vlm/test_token_id_retokenize_e2e.py
test/registered/vlm/test_video_utils.py
test/registered/xpu/test_deepseek_ocr.py
test/registered/xpu/test_deepseek_ocr_triton.py
test/registered/xpu/test_intel_xpu_backend.py
test/registered/xpu/test_topk.py
test/registered/xpu/test_xpu_basic.py
test/sglang/agents/api/test_api_models.py
test/sglang/agents/test_tool_execution.py
test/sglang/agents/test_tool_registry.py
test/sglang/snapshot/README.md
test/sglang/snapshot/__init__.py
test/sglang/snapshot/test_conversation_id_propagation.py
test/sglang/snapshot/test_conversation_tracker.py
test/sglang/snapshot/test_host_pool.py
test/sglang/snapshot/test_mamba_snapshot.py
test/sglang/snapshot/test_runtime_endpoint_identity.py
test/sglang/snapshot/test_scheduler_snapshot_handlers.py
test/sglang/snapshot/test_snapshot_policy.py
test/srt/snapshot/test_restore_consumption_ablation.py

Conflicting files

.claude/skills/add-jit-kernel/SKILL.md
.claude/skills/ci-workflow-guide/SKILL.md
.github/workflows/ci-coverage-overview.yml
.github/workflows/nightly-test-amd-rocm720.yml
.github/workflows/nightly-test-amd.yml
.github/workflows/pr-test-npu.yml
.github/workflows/pr-test-xeon.yml
.github/workflows/pr-test-xpu.yml
.github/workflows/pr-test.yml
python/sglang/srt/configs/model_config.py
python/sglang/srt/managers/schedule_batch.py
python/sglang/srt/managers/scheduler.py
python/sglang/srt/managers/tokenizer_manager.py
python/sglang/srt/mem_cache/memory_pool.py
python/sglang/srt/utils/network.py
sgl-kernel/python/sgl_kernel/flash_mla.py

Next steps

  1. Create a local branch: git checkout -b upstream-sync-manual
  2. Merge upstream: git fetch upstream && git merge upstream/main
  3. Resolve conflicts in the files above
  4. Run fork test suite: pytest test/sglang/snapshot/ -v
  5. Push and open PR

Auto-generated by upstream-sync workflow.

Metadata

Metadata

Assignees

No one assigned

    Labels

    needs-reviewUpstream sync requires manual reviewupstream-syncAutomated upstream sync tracking

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions