cpu perf - #2

Merged

richiejp merged 14 commits into

Jun 16, 2026

Commits on Jun 16, 2026

bench: PyTorch reference + ggml GEMM microbench, exact-length pf-bench

richiejp
and
claude
committed
492f10f
perf: portable AVX-512 CPU build via GGML_CPU_ALL_VARIANTS

richiejp
and
claude
committed
1335000
perf: CPU ablation profiler (PF_PROF) + optional Q8_0 expert requantizer

richiejp
and
claude
committed
70b6d20
docs: CPU performance analysis (SSE-trap root cause, CPU_ALL_VARIANTS fix)

richiejp
and
claude
committed
caebe08
perf: flash attention (default) for CPU and Vulkan

richiejp
and
claude
committed
b3539a9
bench: PF_WINDOW knob + memory columns in pf-bench

richiejp
and
claude
committed
849cea1
perf: prototype O(n*band) banded sliding-window attention

richiejp
and
claude
committed
e754846
perf: integrate banded sliding-window attention (PF_BANDED)

richiejp
and
claude
committed
3fd7003
perf: chunk the MoE FFN over tokens (PF_MOE_CHUNK) to lift the large-window cap

richiejp
and
claude
committed
969af74
docs: MoE chunking + single-window result

richiejp
and
claude
committed
064d840
perf: enable banded attention + MoE chunking by default (length-gated)

richiejp
and
claude
committed
1a21c37
docs: refresh README Bench with the HF-vs-ours comparison

richiejp
and
claude
committed
ad87f72
docs: add speedup column to Bench tables, trim prose

richiejp
and
claude
committed
165bcf6
ci: cap build parallelism (-j4) so the portable build doesn't OOM

richiejp
and
claude
committed
c93aa68