Skip to content

feat: add prefix-cache-affinity dp rank routing.#1860

Open
shifengmin wants to merge 1 commit into
xLLM-AI:mainfrom
shifengmin:feat/prefix-cache-aware-dp-routing
Open

feat: add prefix-cache-affinity dp rank routing.#1860
shifengmin wants to merge 1 commit into
xLLM-AI:mainfrom
shifengmin:feat/prefix-cache-aware-dp-routing