Skip to content

[Bug]: xllm MTP decode target state token mismatch(多节点 shm 服务必现) #1965

Description

@jiangli221

Your environment

编译的xllm的commitID:9daf72d1b3a9aace64c91044467fc58120b1882f

🐛 Describe the bug

脚本开启了MTP,在执行Qwen3.5-27B的精度时服务崩溃,崩溃签名:
F mtp_worker_impl.cpp:387] Check failed: state.token_id == token_id (X vs. Y)
MTP decode target state token mismatch, request_id=chatcmpl-...
调用栈: MTPWorkerImpl::step_decode ← SpeculativeWorkerImpl::step ← WorkerImpl::step_async

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions