refactor: refactor instance managers and load balance policy.#53

magicheng0816 wants to merge 3 commits into

xLLM-AI:mainxLLM-AI/xllm-service:mainfrom

magicheng0816:add_group_managermagicheng0816/xllm-service:add_group_managerCopy head branch name to clipboard