ledger: async scheduling implemented+token-exact but NEUTRAL (prefill AND decode-heavy) => engine is GPU-BOUND not host-bound; conc-32 gap is the GPU prefill-fusion/graph frontier · mudler/vllm.cpp@c8c19f4

4m 48s

5s

4m 53s

Navigation Menu