feat(dsv4): add MXFP4 QAT FP8 expert path#6

Draft

flowerfox-scitix wants to merge 27 commits into

spec/dsv4-mxfp4-qat-fp8-param-gather

Commits on May 8, 2026

fix(dsv4): add gb300 train replay patches
Codex
committed
fix(dsv4): preserve swiglu tp stride contract
Codex
committed
feat(dsv4): absorb DSV4 GB300 Megatron fixes from radixark/Megatron-LM PR#28

Codex
and
claude
committed
fix(dsv4): static audit fixes — remove duplicate _init_routing_mode, fix mlp fc2 latent dim, restore padding_mask parity

Codex
and
claude
committed
fix(dsv4): add moe_latent_size field to TransformerConfig
Codex
committed
fix(dsv4): initialize local_tokens_per_expert=None in TopKRouter.__init__
Codex
committed
fix(dsv4): fix router local_tokens_per_expert/expert_bias init — use register_buffer pattern
Codex
committed
fix(dsv4): remove wrong early-return in hash routing probs shape

Codex
and
claude
committed
fix(dsv4): switch moe_utils topk replay to replay_base manager path

Codex
and
claude
committed

Commits on May 11, 2026

fix(dsv4): propagate bshd padding through moe routing
Codex
committed
fix(dsv4): remove debug grad bucket hook
Codex
committed
fix(dsv4): preserve router and optimizer contracts
Codex
committed

Commits on May 13, 2026

Commits on May 15, 2026

feat(dsv4): trace mxfp4 qat fp8 copy loss
Codex
committed
feat(dsv4): expand mxfp4 qat copy trace
Codex
committed
feat(dsv4): tag qat fp8 copy trace calls
Codex
committed

Commits on May 18, 2026

docs(dsv4): point mxfp4 qat probe reference
Codex
committed
fix(dsv4): match mxfp4 fake qat rounding
Codex
committed
feat(dsv4): sample qat fp8 copy boundaries
Codex
committed
fix(dsv4): add mxfp4 qat scale headroom
Codex
committed

Commits on May 23, 2026

feat(dsv4): gate mxfp4 qat by copy call
Codex
committed

Commits on May 27, 2026

fix(dsv4): remove mxfp4 qat headroom projection
Codex
committed

Commits on May 28, 2026

Commits on Jun 7, 2026

fix(dsv4): gate fp8 checkpoint dequant dtype
Codex
committed