Skip to content

[TRTLLM-11875][feat] BREAKING: MambaCacheManager based on KVCacheManagerV2 & agentic prefix caching#16598

Open
VALLIS-NERIA wants to merge 30 commits into
NVIDIA:mainfrom
VALLIS-NERIA:agent/v2-mamba-snapshot-reuse-core
Open

[TRTLLM-11875][feat] BREAKING: MambaCacheManager based on KVCacheManagerV2 & agentic prefix caching#16598
VALLIS-NERIA wants to merge 30 commits into
NVIDIA:mainfrom
VALLIS-NERIA:agent/v2-mamba-snapshot-reuse-core

Merge latest origin/main into V2 Mamba cache manager (By Agent)

b0925e4
Select commit
Loading
Failed to load commit list.