Skip to content

Track Qwen 3.6 27B support #17

Description

@Pummelchen

Objective

Complete Qwen 3.6 27B as the primary real-model correctness target before model-specific performance claims.

Delivery dependency

This is delivery workstream 2. Implementation starts only after the XAIOS platform milestone and tracker #14 meet their completion criteria. Until then, the Project status is Blocked, not In Progress.

Current verified boundary

Qwen 3.6 27B is interface-only. The model-v2 package and architecture/backend interfaces exist, but official tokenizer parity, transformer execution, logits parity, deterministic decode parity, and physical-hardware validation are incomplete.

Progress gates

  • Stable model-v2 package skeleton and scalar architecture/backend canary
  • Pin immutable official configuration, tokenizer, SafeTensors index, and model implementation revisions
  • Implement bounded-memory streaming import and package-owned tokenizer parity corpus
  • Implement the exact configured hybrid layer plan, including attention/recurrent/convolution state where required
  • Pass embedding, complete-layer, prefill-logit, and at least 32 deterministic decode-step golden gates
  • Pass session save/reload continuity and unsupported-field rejection
  • Add no-expand scalar/NEON/AVX2 and capability-gated optimized backends with differential tests
  • Pass physical Apple and Xeon correctness and benchmark-evidence gates

Status source

Execution status is tracked in the XAIOS GitHub Project. Support claims remain governed by docs/MODEL-SUPPORT.json.

Metadata

Metadata

Assignees

No one assigned

    Labels

    area: cpu-ai-runtimeCPU-only AI runtime, tokenizer, inference path, AI kernels.area: model-arenaModel arena, shared weights, KV/cache, model format.blockedBlocked by dependency, decision, access, or external state.needs: validationNeeds validation evidence or gate run.priority: P1-highHigh-priority work for the current roadmap.type: featureNew capability or user-visible behavior.

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions