Hello, It would be interesting to have a vllm version of this weight sync protocol with a benchmark as well. Kind regards,
Hello,
It would be interesting to have a vllm version of this weight sync protocol with a benchmark as well.
Kind regards,