Skip to content

[TRTLLM-14345][feat] Improve the GDN Replay Kernel Under Low Latency#16768

Open
JadoTu wants to merge 2 commits into
NVIDIA:mainfrom
JadoTu:refine_gdn_replay_low_latency
Open

[TRTLLM-14345][feat] Improve the GDN Replay Kernel Under Low Latency#16768
JadoTu wants to merge 2 commits into
NVIDIA:mainfrom
JadoTu:refine_gdn_replay_low_latency

optimizer runtime, remove the tensor copy ops, replay is now defaultl…

f954542
Select commit
Loading
Failed to load commit list.