Skip to content
Draft
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
216 commits
Select commit Hold shift + click to select a range
69eaff6
Check the time consumption of each hook
yiqingy0 Feb 9, 2026
ea5a224
fix pre-commit
yiqingy0 Feb 9, 2026
f59a909
fix pre-commit
yiqingy0 Feb 9, 2026
408f898
use --verbose
yiqingy0 Feb 9, 2026
cbc682b
Remove 3rdparty/* from clang-format hook
yiqingy0 Feb 10, 2026
62880bc
Revert "Remove 3rdparty/* from clang-format hook"
yiqingy0 Feb 10, 2026
0aef93b
Remove 3rdparty/* from clang-format hook
yiqingy0 Feb 10, 2026
009e7fc
pre-commit run changed files
yiqingy0 Feb 11, 2026
64b0800
fix
yiqingy0 Feb 11, 2026
fbd56aa
fix
yiqingy0 Feb 11, 2026
cdab8d6
Use getMergeRequestChangedFileList to change changed file list
yiqingy0 Feb 12, 2026
be128ee
fix file path
yiqingy0 Feb 12, 2026
ad9b2b5
test clang-format
yiqingy0 Feb 12, 2026
bfcad1b
Revert "test clang-format"
yiqingy0 Feb 12, 2026
a0a4671
Avoid exceeding ARG_MAX
yiqingy0 Feb 12, 2026
c5c2d0f
Update the copyright year to 2026
yiqingy0 Feb 12, 2026
a4a9ee2
Merge branch 'main' into check_pre_commit
yiqingy0 Mar 4, 2026
c684dde
Only check the changed files in github pre-commit check workflow
yiqingy0 Mar 4, 2026
688f4af
fix precommit-check workflow
yiqingy0 Mar 4, 2026
9f682f7
test workflow
yiqingy0 Mar 5, 2026
e417677
test pre-commit workflow
yiqingy0 Mar 5, 2026
8dd3293
Merge branch 'main' into check_pre_commit
yiqingy0 Mar 5, 2026
e79edfb
fix precommit-check
yiqingy0 Mar 5, 2026
2ee7dba
[None][feat] Run extra general warmup to warm up memory pool (#10340)
liji-nv Mar 5, 2026
66def37
Revert "fix precommit-check"
yiqingy0 Mar 5, 2026
3fd39f6
Revert "test workflow"
yiqingy0 Mar 5, 2026
f333c88
Revert "test pre-commit workflow"
yiqingy0 Mar 5, 2026
8c4e7a3
Fix precommit-check
yiqingy0 Mar 5, 2026
496db68
test clang-format
yiqingy0 Mar 5, 2026
a1f4a2b
Revert "test clang-format"
yiqingy0 Mar 5, 2026
517ee94
[None][fix] Fix nemotron super MTP crash on SM90 (#11807)
sunnyqgg Mar 5, 2026
6062df4
[None][chore] Use cluster service discover in disagg CI tests (#11242)
ekou24 Mar 5, 2026
4786834
[None][feat] External Drafter One Model (#11758)
Mar 5, 2026
497b07d
[None][chore] Update model list (#11827)
tcherckez-nvidia Mar 5, 2026
5f1fb7c
[#11578][fix] Use string stop/bad words in gRPC proto instead of pre-…
CatherineSue Mar 6, 2026
e699f23
[None][feat] Add support for bidirectional sliding window attention m…
djns99 Mar 6, 2026
c6dbef2
[None][infra] Check in most recent lock file from nightly pipeline
tensorrt-cicd Mar 6, 2026
dd61fd5
[TRTLLM-11036][feat] Enable new moe test and clean the legacy moe tes…
xxi-nv Mar 6, 2026
93a62dc
[None][infra] Waive 4 failed cases for main in post-merge 2571 (#11968)
ZhanruiSunCh Mar 6, 2026
93ac4a0
[None][test] Fix deepseek-r1 OOM issue for H100 perf test (#11948)
yufeiwu-nv Mar 6, 2026
a018c48
[None][fix] Remove incorrect Python import style rule from AGENTS.md …
yuxianq Mar 6, 2026
a7c0af5
[https://nvbugs/5896577][fix] fix bug of mistral large3 with eagle (#…
byshiue Mar 6, 2026
f639e8b
[https://nvbugs/5819048][fix] unwaive test of qwen3-235b eagle3 (#11969)
byshiue Mar 6, 2026
c6c6dc1
[None][feat] Avoid duplicated computation with ADP + Helix CP in GQA …
brb-nv Mar 6, 2026
191e349
[https://nvbugs/5624818][fix] Add unittest for GPT-OSS non-paged_cont…
pengbowang-nv Mar 6, 2026
7f458ab
[#10245][feat] AutoDeploy: Support Finegrained FP8 quantization (#10897)
bmarimuthu-nv Mar 6, 2026
b94656c
[TRTLLM-11284][infra] Move large models test to post-merge (#11933)
EmmaQiaoCh Mar 6, 2026
dc740c2
[TRTLLM-11155][infra] Run multi-GPU tests even single-GPU tests are f…
yiqingy0 Mar 6, 2026
7eb62e5
Use api to get changed file list
yiqingy0 Mar 6, 2026
4dc7bc5
[None][fix] Refine tests/unittest/_torch/flashinfer/test_trtllm_flash…
yihwang-nv Mar 6, 2026
b5a4e34
[#11422][feat] AutoDeploy: Piecewise cudagraph support Prototype (#11…
nvchenghaoz Mar 6, 2026
5b0c956
[TRTLLM-11189][fix] VisualGen isolated TeaCache Wan fix (#11964)
o-stoner Mar 6, 2026
22c4706
[https://nvbugs/5846166][fix] Update Perf Triage Scripts to Fix gen_o…
chenfeiz0326 Mar 6, 2026
ac8bc6e
[TRTLLM-11057][feat] Add Helix CP support for DSV3.2 (#11507)
brb-nv Mar 6, 2026
427369e
[#2912][feat] Support Cohere Command A model (#11505)
torotoki Mar 6, 2026
498b25c
[TRTLLM-11259][perf] Parallel VAE harness and implementation for WAN …
NVShreyas Mar 6, 2026
5918348
[#11578][feat] support multimodal image input in gRPC server (#11800)
CatherineSue Mar 6, 2026
d1ba3b8
[TRTLLM-11093][feat] add 5D A2A for fused ulysses (#11787)
NVShreyas Mar 6, 2026
7dbda08
[TRTLLM-11189][fix] Fix TeaCache broken caching for FLUX.1 and FLUX.2…
karljang Mar 6, 2026
2087b24
[None][refactor] Request management in ScheduledRequests (#11784)
Funatiq Mar 7, 2026
10348f8
[None][perf] Add Triton FP8 blockwise quant kernel and autotuner buck…
chang-l Mar 7, 2026
2eb332c
[TRTLLM-11290][feat] Enable trtllm-serve E2E tests (#11985)
JunyiXu-nv Mar 7, 2026
cc16289
[None][feat] Optimize by fuse nvfp4_quant to layernorm_gated for mamb…
Wanli-Jiang Mar 7, 2026
dd8ffbd
[None][infra] Check in most recent lock file from nightly pipeline
tensorrt-cicd Mar 7, 2026
86e0282
[None][chore] Autodeploy: add models for sprint (#11999)
nvchenghaoz Mar 7, 2026
656091b
[None][infra] Update CI allow list 20260305 (#11965)
yuanjingx87 Mar 7, 2026
1dcb6ec
[https://nvbugs/5809169][unwaive] Unwaive TestGPTOSS test (#11416)
peaceh-nv Feb 26, 2026
039b06f
[https://nvbugs/5859881][fix] Unwaive test (#11716)
hyukn Feb 26, 2026
75e038e
[None][feat] add sanity tests for release1.2 version (#11738)
yingguo-trt Feb 26, 2026
05bb5c1
[https://nvbugs/5889841][fix] Add custom option class to allow subcom…
FrankD412 Feb 26, 2026
b548320
[https://nvbugs/5875522][docs] Add known issue for disaggregated serv…
Tabrizian Feb 27, 2026
2f725ea
[https://nvbugs/5775256] [fix] Reopen fp8_dsl_fused_moe ut. (#11779)
limin2021 Mar 2, 2026
07fbb5d
[https://nvbugs/5762822][chore] Unwaive longbenchV2 test (#11647)
heyuhhh Mar 2, 2026
2d9ed59
[https://nvbugs/5936273][fix] Fix bugs of Mistral Large3 (#11885)
byshiue Mar 4, 2026
9c6ce75
[https://nvbugs/5949098][doc] Fixing docs links (#11912)
pcastonguay Mar 4, 2026
f4593cf
[None][doc] Replace the TensorRT-LLM with TensorRT LLM (#11914)
nv-guomingz Mar 5, 2026
0579ac6
[None][chore] Fix/disagg perf failure detection (#11904)
yingguo-trt Mar 5, 2026
a0a9e33
Update tests/integration/test_lists/waives.txt
chzblych Mar 7, 2026
6b04973
[None][fix] Fix Collect Perf Sanity Result's import requests Error (#…
chenfeiz0326 Mar 7, 2026
b9bd3d4
[None][infra] Check in most recent lock file from nightly pipeline
tensorrt-cicd Mar 8, 2026
5eb8eab
[TRTLLM-10956][infra] Skip updating gitlab status for GenPostMergeBui…
mzweilz Mar 8, 2026
69b6203
[None][feat] add ReLU2 NVFP4 fusion for AutoDeploy with tests (#11957)
tcherckez-nvidia Mar 8, 2026
f931f4e
[TRTLLM-11159][feat] Wire KVCacheBlock to UnifiedBlockTree, replacing…
SimengLiu-nv Mar 8, 2026
595a51d
[#11166][infra] AutoDeploy: improve test organization in CI and add o…
lucaslie Mar 8, 2026
89acff3
Model update 260308 (#12011)
tcherckez-nvidia Mar 8, 2026
6ec0aad
[None][infra] Update AutoDeploy CODEOWNERS coverage (#12013)
lucaslie Mar 9, 2026
4c15db0
[https://nvbugs/5732958][bug] Fix TestLlama4MinLatency::test_llama_al…
nvpohanh Mar 9, 2026
db533cf
[None][chore] Unwaive some skip for trtllm moe backend (#11975)
leslie-fang25 Mar 9, 2026
02c8a94
[TRTLLM-11134][feat] export VisualGen API and update doc (#11911)
zhenhuaw-me Mar 9, 2026
06ec492
[None][infra] Check in most recent lock file from nightly pipeline
tensorrt-cicd Mar 9, 2026
066ca48
[https://nvbugs/5823783][test] add qa test case for trust-remote-code…
crazydemo Mar 9, 2026
357378b
[None][feat] Use max_gpu_total_bytes to control v2's capacity (#11907)
jiaganc Mar 9, 2026
7b4da2b
[TRTLLM-11342][fix] Fix FLUX.1 TeaCache polynomial coefficients and d…
karljang Mar 9, 2026
ba0ad13
[None][fix] Use try/except fallback for Pydantic ValidatorIterator in…
Wanli-Jiang Mar 9, 2026
18af5ef
[None][infra] Unwaive 2 cases on rtx-pro-6000d (#12003)
EmmaQiaoCh Mar 9, 2026
76a70b4
[TRTLLM-11276][chore] Expose use_python_scheduler in SchedulerConfig …
lancelly Mar 9, 2026
d1ac900
[None][infra] Waive 7 failed cases for main in post-merge 2576 (#12014)
ZhanruiSunCh Mar 9, 2026
165b61c
[https://nvbugs/5948878][fix] Implement workaround for ClientPayloadE…
yingguo-trt Mar 9, 2026
91233d5
[TRTLLM-10407][feat] Integrate CuTE DSL top-k kernel for Blackwell (#…
limin2021 Mar 9, 2026
1074aa9
[TRTLLM-11148][perf] _prepare_inputs host time optimization (#11704)
hyukn Mar 9, 2026
cf484a0
[None][test] Fix model_name starcoder_15b is not in allowed_models is…
yufeiwu-nv Mar 9, 2026
d17046d
[None][infra] Waive 5 failed cases for main in post-merge 2578 (#12023)
ZhanruiSunCh Mar 9, 2026
5b4ff40
[None][chore] AutoDeploy: re-enable nvfp4 superv3 accuracy test (#11945)
galagam Mar 9, 2026
d704b5e
[None][chore] Remove visual_gen benchmark test from YAML (#12027)
zhenhuaw-me Mar 9, 2026
a176d83
[None][fix] Fix the model list as it had a dup model (#12029)
tcherckez-nvidia Mar 9, 2026
34a9153
[https://nvbugs/5863806][fix] Fix Python string truthiness bug in FMH…
luyiyun1021 Mar 9, 2026
9fe24db
[None][feat] Upgrade xgrammar from 0.1.25 to 0.1.32 (#12016)
sunnyqgg Mar 9, 2026
27cab47
[https://nvbugs/5924144][test] unwaive cpp/test_unit_tests.py::test_u…
Funatiq Mar 9, 2026
7a68c42
[None][chore] limit tileiras to CUDA13.1 (#12042)
tburt-nv Mar 9, 2026
ae2dc3d
[None][feat] Add silu to trtllm-gen MoE (#11663)
IwakuraRein Mar 9, 2026
d3a16b3
[TRTLLM-11045][feat] Integrate SA with EAGLE3 and PARD (#11878)
cascade812 Mar 9, 2026
3b82b6c
[None][chore] waive test_visual_gen_quickstart (#12043)
tburt-nv Mar 9, 2026
69de4a6
[None][feat] NIXL support for hybrid model cache transfer (#11608)
NVShreyas Mar 9, 2026
7747f25
[None][feat] Add Auto-Deploy dashboard failures analysis skill (#12033)
tcherckez-nvidia Mar 9, 2026
2fe7b14
[https://nvbugs/5820511][fix] Upgrade Cutlass version (#11956)
pamelap-nvidia Mar 9, 2026
35ccedd
[None][feat] Add AD model list validation checks to pre-commit and PR…
tcherckez-nvidia Mar 9, 2026
e3d4ba7
[None][chore] Clarify DCO sign-off and co-author guidelines in AGENTS…
kaiyux Mar 10, 2026
8d8b84b
[TRTLLM-7784][feat] Basic SSM support in KVCacheManagerV2 (#11976)
lowsfer Mar 10, 2026
3139ffa
[None][infra] Check in most recent lock file from nightly pipeline
tensorrt-cicd Mar 10, 2026
51e3508
[None][test] Add QA's perf test cases with L0 local mode (#12022)
fredricz-20070104 Mar 10, 2026
b411e14
[TRTLLM-11246][feat] Add tool parser support for GLM-4 models (#11986)
JunyiXu-nv Mar 10, 2026
a20de88
[https://nvbugs/5937478][fix] Fix DS v32 tool calling type and parse …
JunyiXu-nv Mar 10, 2026
39d294b
[TRTLLM-11135][fix] Fix vulnerabilities protobuf and aiohttp (#11898)
yiqingy0 Mar 10, 2026
81350b7
[None][chore] Align perf benchmark output format (#12067)
yingguo-trt Mar 10, 2026
1fef88e
[None][chore] Improve sampler performance by replacing torch.where wi…
stnie Mar 10, 2026
72598de
[None][infra] Waive 1 failed cases for main in post-merge 2582 (#12069)
ZhanruiSunCh Mar 10, 2026
9a070ed
[TRTLLM-10421][perf] Add fused cat+fp8_quantize CUDA kernel for DSA i…
kaiyux Mar 10, 2026
f20346c
[None][test] Fix disagg sku (#12065)
fredricz-20070104 Mar 10, 2026
6f3acc0
[https://nvbugs/5892646][perf] Long-sequence token-parallel optimizat…
nvxuanyuc Mar 10, 2026
3ce0ec8
[TRTLLM-11265][feat] Implement dynamic resolution for Nemotron VL (#1…
2ez4bz Mar 10, 2026
2bc2acd
[https://nvbugs/5708901][perf] reduce logprobs=0 overhead in TorchSam…
ixlmar Mar 10, 2026
c96c68f
[None][feat] NVFP4 TRTLLM-Gen MoE for AutoDeploy (Nemotron Super) (#1…
tcherckez-nvidia Mar 10, 2026
885fedd
[https://nvbugs/5963896][fix] Remove test `test_visual_gen_quickstart…
chang-l Mar 11, 2026
04cefe2
[TRTLLM-11535][feat] Fixed NVFP4 sharding (#11618)
greg-kwasniewski1 Mar 11, 2026
2afe11d
[None][fix] Improve KV Event Batching (#11883)
jthomson04 Mar 11, 2026
bba2981
[None][chore] Add failed cases into waives.txt (#12047)
xinhe-nv Mar 11, 2026
97e98ef
[None][infra] Check in most recent lock file from nightly pipeline
tensorrt-cicd Mar 11, 2026
a154da6
[TRTLLM-11276][fix] Fix Kimi-K2.5 accuracy test skip condition and re…
lancelly Mar 11, 2026
4dee46e
[https://nvbugs/5919026][fix] Pass sparse_attn_config from effective_…
chenfeiz0326 Mar 11, 2026
bf897e6
[None][fix] MTP Advanced Sampling Topk IMA (#12088)
Mar 11, 2026
71ffd8b
[None][fix] Revert "[None][chore] KV Connector Refactor (#11078)" (#1…
jthomson04 Mar 11, 2026
8dddfb4
[None][chore] Bump version to 1.3.0rc8 (#12090)
yuanjingx87 Mar 11, 2026
ecf0057
[None][chore] Refine AlltoAll benchmark scripts. (#11649)
bobboli Mar 11, 2026
f7255e0
[None][feat] 2FP4 / Arcquant. (#11333)
Tracin Mar 11, 2026
e03e361
[None][fix] Fix Upload Build Info branch and run in post always (#12025)
mzweilz Mar 11, 2026
fa31ce0
[TRTLLM-11366][feat] Add dedicated virtual memory tag for model weigh…
tongyuantongyu Mar 11, 2026
298b6c8
[https://nvbugs/5961430][fix] Fix CI issue of Mistral Large3 (#12073)
byshiue Mar 11, 2026
611ca65
[None][test] add Perf sanity gb200 test into QA test db (#11882)
xinhe-nv Mar 11, 2026
b8c96d4
[None][infra] Waive 2 failed cases for main in post-merge 2584 (#12108)
ZhanruiSunCh Mar 11, 2026
5319f83
[None][chore] Waive mpi hang test case (#12077)
jieli-matrix Mar 11, 2026
627c96c
[None][chore] re-enable benchmark test in post merge (#12035)
zhenhuaw-me Mar 11, 2026
73fca4e
[None][feat] Mamba optimization and mixed quantization support for ne…
Wanli-Jiang Mar 11, 2026
9c26e22
[None][fix] Various fixes for agentic flow (#12061)
2ez4bz Mar 11, 2026
9b545e2
[https://nvbugs/5936322][fix] Fix sporadic port collision in multigpu…
MrGeva Mar 11, 2026
d362846
[TRTLLM-9523][feat] Adapting the transceiver to manager v2 (step 6) (…
Shixiaowei02 Mar 11, 2026
be57adb
[TRTLLM-11928][feat] Fix sharding overwrite with multiple graph modul…
greg-kwasniewski1 Mar 11, 2026
906781b
[https://nvbugs/5948539][fix] Fix disagg gen-only benchmark (#12091)
Tabrizian Mar 11, 2026
873a01e
[None][fix] Split mContextChunkSize into per-target/draft fields (#12…
Hrithvik-Alex Mar 11, 2026
f90b35f
[None][fix] Fix ValueError and missing decoding statistics for MTP (#…
cascade812 Mar 11, 2026
0350b7f
[None][fix] Enable more KV connector priority tests in CI (#11892)
jthomson04 Mar 11, 2026
b79f4c7
[https://nvbugs/5923949][fix] Improve NCCL library load stability (#1…
nv-lschneider Mar 11, 2026
ea4d4d1
[None][feat] Enable non-gated activation to the new MoE test (#11996)
IwakuraRein Mar 11, 2026
ae2bd16
[None][infra] Update CI allow list (#12119)
yuanjingx87 Mar 11, 2026
7479423
[None][chore] Unwaiving disagg tests failing with address in use erro…
pcastonguay Mar 11, 2026
bf7142f
[https://nvbugs/5955170][fix] Disable TRTLLM GEN Routing PDL due to n…
dongfengy Mar 11, 2026
be20657
[None][fix] Enforce minimum NVSHMEM_QP_DEPTH of 128 for DeepEP low la…
Tabrizian Mar 12, 2026
2578637
[None][refactor] parallel vae refactor (#12123)
NVShreyas Mar 12, 2026
6739c11
[https://nvbugs/5826604][test] Remove test waive for Llama3.1 8B bflo…
syuoni Mar 12, 2026
0ce3651
[TRTLLM-11257][infra] Unwaive TestDeepSeekR1::test_fp8_blockscale[thr…
zhaoyangwang-nvidia Mar 12, 2026
3f9f757
[None][infra] Waive 2 failed cases for main in post-merge 2586 (#12134)
ZhanruiSunCh Mar 12, 2026
959306c
[None][infra] Check in most recent lock file from nightly pipeline
tensorrt-cicd Mar 12, 2026
21a696b
[None][feat] Optimize the q3n decode kernel with IO read (#11344)
JadoTu Mar 12, 2026
803510d
[None][chore] Add failed cases into waives.txt (#12093)
xinhe-nv Mar 12, 2026
e824264
[TRTLLM-11092][feat] add support for visual gen FA4 attention backend…
o-stoner Mar 12, 2026
a865b6c
[https://nvbugs/5955173][fix] Add abort method for GenerationResultBa…
JunyiXu-nv Mar 12, 2026
1160f19
[None][test] Add speculative decoding test with exclude_input_in_outp…
StanleySun639 Mar 12, 2026
8de01ac
[None][feat] Add shared expert LoRA support for MoE models in PyTorch…
achartier Mar 12, 2026
5dc4318
[https://nvbugs/5846166][bug] Fix Disagg Perf Test's MPI Issue and Po…
chenfeiz0326 Mar 12, 2026
a4e6745
[TRTLLM-10244][doc] Add deployment guide for Nemotron 3 Super (#12129)
nv-guomingz Mar 12, 2026
adfc542
[None][fix] Narrow bare except clause and use identity check for None…
edenfunf Mar 12, 2026
f11eea7
[TRTLLM-10303][feat] Deprecate trtllm-serve CLI options (#12106)
JunyiXu-nv Mar 12, 2026
dc37798
[#11800][fix] Add keepalive ping tolerance and context.abort to gRPC …
CatherineSue Mar 12, 2026
0c19c8e
[None][test] Add e2e tests for KV cache connector async loading path …
Tabrizian Mar 12, 2026
7c64f4b
[TRTLLMINF-11][chore] Change image used for Preparation step of CI (#…
dpitman-nvda Mar 12, 2026
5cc0ccd
[https://nvbugs/5973199][fix] support attn-dp TRTLLM-Gen NVFP4 MoE fu…
tcherckez-nvidia Mar 12, 2026
2eee701
[TRTLLM-10617][feat] LTX-2 Model Support (#12009)
yibinl-nvidia Mar 13, 2026
0507609
[TRTLLM-10695][ci] add verl stage in CI (#11306)
Superjomn Mar 13, 2026
c0cf5a3
[None][feat] Optimize 6KD fp8 blockscale gemm (#11502)
CarstyYou Mar 13, 2026
94f9489
[https://nvbugs/5949033][fix] Add 3 Disagg gen_only tests back (#12159)
chenfeiz0326 Mar 13, 2026
e226930
[TRTLLM-11037][bug] Fix MoE DeepEP hang caused by non-deterministic G…
xxi-nv Mar 13, 2026
b0cec7f
[None][infra] Check in most recent lock file from nightly pipeline
tensorrt-cicd Mar 13, 2026
0fc0cbd
[None][feat] Add flashinfer api for TRTLLMGenFusedMoE (#10453)
rosong11 Mar 13, 2026
60091ff
[None][Test] Add multinode e2e and accuracy cases on DGX-Spark (#12110)
JennyLiu-nv Mar 13, 2026
2727092
[TRTLLM-11207][requirements] Update numpy version to 2 (#11280)
Funatiq Mar 13, 2026
b65c9ac
[None][chore] Fix KVCacheManagerV2 shrink for last level and improve …
lowsfer Mar 13, 2026
fb7c634
[TRTLLM-10319][feat] Dynamic draft length on spec decode one-model pa…
zheyuf Mar 13, 2026
18d02df
[TRTLLM-11288][feat] Configurable warmup shapes for VisualGen (#12107)
luyiyun1021 Mar 13, 2026
3fb931a
[None][feat] add trtllm-gen kernels for glm4.7 and support groupsToke…
PerkzZheng Mar 13, 2026
1a2849a
[None][fix] Fixed mamba cache issue for pp>1 (#12146)
Wanli-Jiang Mar 13, 2026
390a7fd
[None][feat] Qwen3.5 perf optimizations (#11581)
suyoggupta Mar 13, 2026
7754c66
[None][feat] Add mix-precision checkpoint support in AutoDeploy (#12175)
Fridah-nv Mar 13, 2026
9a9dc3c
[https://nvbugs/5944411][fix] Handle anyOf parameter schemas in Qwen3…
tijyojwad Mar 13, 2026
1e0b9ea
[None][infra] Check in most recent lock file from nightly pipeline
tensorrt-cicd Mar 14, 2026
3380889
[None][infra] Waive failed A10-PyTorch-1 test in pre-merge (#12207)
yuanjingx87 Mar 14, 2026
8cdcce9
[None][fix] Add streaming support to no </think> for nemotron model (…
tijyojwad Mar 14, 2026
267396c
[None][chore] Add explicit error for intermediate size misalignment w…
leslie-fang25 Mar 15, 2026
afe7314
[None][infra] Check in most recent lock file from nightly pipeline
tensorrt-cicd Mar 15, 2026
e3e6a38
[https://nvbugs/5973316][fix] fix deepep with trtllm moe backend and …
leslie-fang25 Mar 15, 2026
b20dd45
[TRTLLM-8922][feat] py cache transceiver for gen-first workflow (#11941)
reasonsolo Mar 15, 2026
4be2fda
[None][fix] remove test_llm_api_autodeploy.py::TestNemotronSuperV3::t…
tcherckez-nvidia Mar 15, 2026
8766e81
[None][infra] Waive 9 failed cases for main in post-merge 2593 (#12224)
ZhanruiSunCh Mar 15, 2026
73cca36
[None][fix] port retry loop and exception handling (#12225)
MrGeva Mar 15, 2026
b802a38
[TRTLLM-10929][feat] add fp8 combine in moe_a2a (#11844)
dc3671 Mar 16, 2026
677cdf6
[TRTLLM-9767][feat] Enable attention dp for qwen3-next. (#10218)
nv-guomingz Mar 16, 2026
8e13bf3
[None][infra] Check in most recent lock file from nightly pipeline
tensorrt-cicd Mar 16, 2026
01484da
Merge branch 'main' into check_pre_commit
yiqingy0 Mar 16, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
The diff you're trying to view is too large. We only load the first 3000 changed files.
317 changes: 317 additions & 0 deletions .claude/skills/ad-pipeline-failure-pr/SKILL.md

Large diffs are not rendered by default.

6 changes: 4 additions & 2 deletions .github/CODEOWNERS
Original file line number Diff line number Diff line change
Expand Up @@ -59,8 +59,10 @@
/tensorrt_llm/_torch/pyexecutor @NVIDIA/trt-llm-torch-runtime-devs
## TensorRT-LLM Pytorch backend - AutoDeploy flow
/tensorrt_llm/_torch/auto_deploy @NVIDIA/trt-llm-torch-autodeploy-devs
/examples/auto_deploy @NVIDIA/trt-llm-torch-autodeploy-devs @NVIDIA/trt-llm-doc-owners
/tests/unittest/_torch/auto_deploy @NVIDIA/trt-llm-torch-autodeploy-devs
/examples/auto_deploy @NVIDIA/trt-llm-torch-autodeploy-devs
/docs/source/features/auto_deploy @NVIDIA/trt-llm-torch-autodeploy-devs @NVIDIA/trt-llm-doc-owners
/tests/unittest/auto_deploy @NVIDIA/trt-llm-torch-autodeploy-devs
/tests/integration/defs/accuracy/test_llm_api_autodeploy.py @NVIDIA/trt-llm-torch-autodeploy-devs @NVIDIA/trt-llm-qa-function

## TensorRT-LLM Pytorch - Speculative Decoding
/tensorrt_llm/_torch/speculative @NVIDIA/trt-llm-torch-spec-decoding
Expand Down
6 changes: 6 additions & 0 deletions .github/workflows/blossom-ci.yml
Original file line number Diff line number Diff line change
Expand Up @@ -101,10 +101,12 @@ jobs:
"dpitman-nvda",
"DylanChen-NV",
"ebarilanM",
"ekou24",
"elvischenv",
"EmmaQiaoCh",
"eopXD",
"esha-nvidia",
"etz-lmn",
"evezhier",
"faradawn",
"farazkh80",
Expand Down Expand Up @@ -140,6 +142,7 @@ jobs:
"JadoTu",
"jaedeok-nvidia",
"jdemouth-nvidia",
"janbernloehr",
"JennyLiu-nv",
"jershi425",
"jgangani",
Expand Down Expand Up @@ -227,6 +230,7 @@ jobs:
"nvzhihanj",
"nvzhou",
"nzmora-nvidia",
"o-stoner",
"omera-nv",
"pamelap-nvidia",
"pcastonguay",
Expand Down Expand Up @@ -317,6 +321,7 @@ jobs:
"xinhe-nv",
"xmchen1987",
"xrq-phys",
"xuantengh",
"xuanzic",
"xueweilnvidia",
"xupinjie",
Expand Down Expand Up @@ -351,6 +356,7 @@ jobs:
"zerollzeng",
"zhanga5",
"zhangcl",
"zhaoyangwang-nvidia",
"ZhanruiSunCh",
"zhengd-nv",
"zhenhuaw-me",
Expand Down
40 changes: 40 additions & 0 deletions .github/workflows/model-registry-check.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,40 @@
# SPDX-FileCopyrightText: Copyright (c) 2026 NVIDIA CORPORATION & AFFILIATES. All rights reserved.
# SPDX-License-Identifier: Apache-2.0
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.

name: Model Registry Check

on:
pull_request:
types: [opened, edited, synchronize, reopened]
paths:
- examples/auto_deploy/model_registry/models.yaml

jobs:
validate-model-registry:
name: Validate AutoDeploy Model Registry
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v6

- uses: actions/setup-python@v6
with:
python-version: "3.12"
cache: "pip"

- name: Install validator dependency
run: python3 -m pip install PyYAML

- name: Validate model registry
run: python3 scripts/check_model_registry.py
17 changes: 16 additions & 1 deletion .github/workflows/precommit-check.yml
Original file line number Diff line number Diff line change
Expand Up @@ -38,6 +38,21 @@ jobs:
python-version: '3.12'
cache: 'pip'

- name: Get changed files
id: changed-files
if: github.event_name == 'pull_request'
env:
GH_TOKEN: ${{ github.token }}
run: |
files=$(gh api "repos/${{ github.repository }}/pulls/${{ github.event.pull_request.number }}/files" \
--paginate --jq '.[].filename' | paste -sd ' ' -)
echo "files=$files" >> $GITHUB_OUTPUT

- name: Run pre-commit checks
run: |
python3 -u scripts/release_check.py
if [ "${{ github.event_name }}" = "pull_request" ]; then
echo "${{ steps.changed-files.outputs.files }}" | tr ' ' '\n' | sed '/^$/d' > changed_files.txt
python3 -u scripts/release_check.py --files-from changed_files.txt
else
python3 -u scripts/release_check.py
fi
18 changes: 10 additions & 8 deletions .pre-commit-config.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -1368,7 +1368,7 @@ common-files: &common_files |
)$

# Global exclude pattern for vendored third-party code
exclude: '^triton_kernels/'
exclude: '(^triton_kernels/|trtllmGenKernels/fmha/cubin/kernelMetaInfo\.h$|cubin\.cpp$|cubin\.h$)'

default_install_hook_types: [pre-commit, commit-msg]
repos:
Expand All @@ -1390,14 +1390,10 @@ repos:
rev: v6.0.0
hooks:
- id: check-added-large-files
exclude: |
(?x)^(.*cubin.cpp | .*cubin.h)$
- id: check-merge-conflict
- id: check-symlinks
- id: detect-private-key
- id: end-of-file-fixer
exclude: |
(?x)^(.*cubin.cpp | .*cubin.h)$
- id: check-yaml
args: [--allow-multiple-documents, --unsafe]
exclude: ".*/gitlab/.*.yml"
Expand Down Expand Up @@ -1429,8 +1425,6 @@ repos:
hooks:
- id: clang-format
types_or: [c++, c, cuda]
exclude: |
(?x)^(.*cubin.cpp$ | .*_cubin.h)$
- repo: https://github.com/cheshirekow/cmake-format-precommit
rev: v0.6.10
hooks:
Expand All @@ -1442,7 +1436,7 @@ repos:
additional_dependencies:
- tomli
# add ignore words list
args: ["-L", "Mor,ans,thirdparty,subtiles,PARD,pard", "--skip", "ATTRIBUTIONS-*.md,*.svg", "--skip", "security_scanning/*"]
args: ["-L", "Mor,ans,thirdparty,subtiles,PARD,pard,therefrom", "--skip", "ATTRIBUTIONS-*.md,*.svg", "--skip", "security_scanning/*", "--skip", "tensorrt_llm/_torch/visual_gen/jit_kernels/*"]
exclude: 'scripts/attribution/data/cas/.*$'
- repo: https://github.com/astral-sh/ruff-pre-commit
rev: v0.9.4
Expand All @@ -1459,6 +1453,14 @@ repos:
files: ".*/auto_deploy/.*"
- repo: local
hooks:
- id: model-registry-check
name: Validate AutoDeploy model registry
entry: python scripts/check_model_registry.py
language: python
additional_dependencies:
- PyYAML
files: ^examples/auto_deploy/model_registry/models\.yaml$
pass_filenames: false
- id: test lists format
name: Check for tabs and multiple spaces in test_lists txt files
entry: ./scripts/format_test_list.py
Expand Down
14 changes: 14 additions & 0 deletions 3rdparty/CMakeLists.txt
Original file line number Diff line number Diff line change
Expand Up @@ -30,6 +30,7 @@ foreach(DEP_IDX RANGE ${DEP_COUNT_MINUS_ONE})
string(JSON DEP_SOURCE_SUBDIR ERROR_VARIABLE _err GET "${DEP_OBJECT}" "source_subdir")
string(JSON DEP_GIT_SUBMODULES_RECURSE ERROR_VARIABLE _err GET "${DEP_OBJECT}" "git_submodules_recurse")
string(JSON DEP_USE_URL ERROR_VARIABLE _err GET "${DEP_OBJECT}" "use_url")
string(JSON DEP_PATCH_FILE ERROR_VARIABLE _err GET "${DEP_OBJECT}" "patch_file")
# cmake-format: on

# Build FetchContent_Declare arguments
Expand All @@ -53,6 +54,19 @@ foreach(DEP_IDX RANGE ${DEP_COUNT_MINUS_ONE})
list(APPEND FETCH_ARGS SOURCE_SUBDIR "${DEP_SOURCE_SUBDIR}")
endif()

if(DEP_PATCH_FILE AND NOT DEP_PATCH_FILE STREQUAL "")
list(
APPEND
FETCH_ARGS
PATCH_COMMAND
patch
-p1
--forward
--batch
-i
"${CMAKE_CURRENT_SOURCE_DIR}/${DEP_PATCH_FILE}")
endif()

FetchContent_Declare(${FETCH_ARGS})

# Special handling: Export deep_ep commit to global property
Expand Down
7 changes: 4 additions & 3 deletions 3rdparty/fetch_content.json
Original file line number Diff line number Diff line change
Expand Up @@ -11,7 +11,7 @@
{
"name": "cutlass",
"git_repository": "https://github.com/NVIDIA/cutlass",
"git_tag": "v4.3.0",
"git_tag": "v4.4.1",
"git_shallow": true,
"source_subdir": "dont-add-this-project-with-add-subdirectory"
},
Expand Down Expand Up @@ -93,9 +93,10 @@
{
"name": "xgrammar",
"git_repository": "https://github.com/mlc-ai/xgrammar",
"git_tag": "v0.1.25",
"git_tag": "v0.1.32",
"git_shallow": true,
"source_subdir": "dont-add-this-project-with-add-subdirectory"
"source_subdir": "dont-add-this-project-with-add-subdirectory",
"patch_file": "patches/xgrammar_constexpr.patch"
}
]
}
19 changes: 19 additions & 0 deletions 3rdparty/patches/xgrammar_constexpr.patch
Original file line number Diff line number Diff line change
@@ -0,0 +1,19 @@
--- a/cpp/grammar_functor.cc
+++ b/cpp/grammar_functor.cc
@@ -1750,11 +1750,11 @@
void Apply(Grammar* grammar);
static std::optional<uint64_t> HashSequence(const Grammar& grammar, int32_t sequence_id);

- static const int16_t kNotEndStateFlag = -0x100;
- static const int16_t kEndStateFlag = -0x200;
- static const int16_t kSelfRecursionFlag = -0x300;
- static const int16_t kSimpleCycleFlag = -0x400;
- static const int16_t kUnKnownFlag = -0x500;
+ static constexpr int16_t kNotEndStateFlag = -0x100;
+ static constexpr int16_t kEndStateFlag = -0x200;
+ static constexpr int16_t kSelfRecursionFlag = -0x300;
+ static constexpr int16_t kSimpleCycleFlag = -0x400;
+ static constexpr int16_t kUnKnownFlag = -0x500;

private:
Grammar* grammar_;
6 changes: 2 additions & 4 deletions AGENTS.md
Original file line number Diff line number Diff line change
Expand Up @@ -10,11 +10,10 @@ Python and C++ codebase supporting TensorRT engine-based and PyTorch-based execu
**CRITICAL (YOU MUST):**
- Read and follow `CODING_GUIDELINES.md` for ALL code changes (C++ and Python)
- NVIDIA copyright header on ALL new files (update year on modified files)
- `git commit -s` (DCO sign-off required). Never attribute AI tools in sign-off line. Do not add
co-authors to the git commit message unless explicitly instructed to do so by the user.
- `git commit -s` (DCO sign-off required). Never attribute AI tools in sign-off line. Always rely on `git` to do the sign off instead of directly adding sign off in commit message.
- Do not add co-authors to the git commit message unless explicitly instructed to do so by the user.
- `pre-commit` hooks run on commit — if files are modified by hooks, re-stage and commit again
- PR title format: `[JIRA/NVBUG/None][type] description` (e.g., `[TRTLLM-5516][perf] optimize cuda graph padding`)
- Python imports: `from package.subpackage import module` (never `from module import Class`)
- Set `LLM_MODELS_ROOT` env var when running tests that need model weights

## Common Commands
Expand Down Expand Up @@ -101,7 +100,6 @@ HuggingFace Model → LLM API → Executor (PyTorch/AutoDeploy/TensorRT)
- **Integration tests need GPUs + models** — always set `LLM_MODELS_ROOT` and ensure GPU access. Unit tests don't.
- **Copyright year** — update to current year when modifying existing files; add full header to new files.
- **Avoid broad exception handling** — catch specific exceptions, not bare `except:` (see `CODING_GUIDELINES.md`).
- **Python import style is enforced** — `from package.subpackage import module`, never `from module import Class`. Pre-commit will not catch this.
- **One concern per PR** — avoid scope creep. If a PR touches unrelated areas, split it.
- **User-facing configuration classes** - when editing or defining any user-facing configuration classes (particularly `LlmArgs` or any class used in its fields), you **MUST** follow the Pydantic guidelines in `CODING_GUIDELINES.md`.

Expand Down
4 changes: 2 additions & 2 deletions ATTRIBUTIONS-Python.md
Original file line number Diff line number Diff line change
Expand Up @@ -5261,7 +5261,7 @@ For more information, please refer to <http://unlicense.org>
- `Tracker`: https://github.com/tox-dev/py-filelock/issues


## flashinfer-python (0.6.4)
## flashinfer-python (0.6.6)

### Licenses
License: `Apache-2.0`
Expand Down Expand Up @@ -63471,7 +63471,7 @@ SOFTWARE.
- `Homepage`: https://github.com/akshaynagpal/w2n


## xgrammar (0.1.25)
## xgrammar (0.1.32)

### Licenses
License: `Apache 2.0`
Expand Down
Loading
Loading