Skip to content

Size issue trying to run unsloth/Qwen3.6-27B-NVFP4 with b12x_attn (fathomless-firmament-ds4-v10 image) #29

Description

@jeremylea

(EngineCore pid=152341) ERROR 07-11 20:42:08 [core.py:1243] File "/opt/sglang/ds4-v10/lib/python3.12/site-packages/b12x/integration/paged_attention_scratch.py", line 712, in copy_runtime_metadata
(EngineCore pid=152341) ERROR 07-11 20:42:08 [core.py:1243] self.page_table[: page_table_i32.shape[0], : page_table_i32.shape[1]].copy
(
(EngineCore pid=152341) ERROR 07-11 20:42:08 [core.py:1243] RuntimeError: The size of tensor a (4096) must match the size of tensor b (4100) at non-singleton dimension 1

This happens during startup without MTP, but only on first use with MTP.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions