fix(server): fail-fast unschedulable KV waits - #227

fix(server): fail-fast unschedulable KV waits#227

bakon11 wants to merge 1 commit into

mudler:mainmudler/vllm.cpp:mainfrom

bakon11:fix/serve-kv-abort-max-tokensbakon11/vllm.cpp:fix/serve-kv-abort-max-tokensCopy head branch name to clipboard