Skip to content

Add KV-cache quantization (kv_bits 8|4), golden-gated against mlx-lm#34

Merged
hvasconcelos merged 1 commit into
masterfrom
kv-cache-quantization
Jun 11, 2026
Merged

Add KV-cache quantization (kv_bits 8|4), golden-gated against mlx-lm#34
hvasconcelos merged 1 commit into
masterfrom
kv-cache-quantization

Add KV-cache quantization (kv_bits 8|4), golden-gated against mlx-lm

8d2fea9
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 warning
Build & test (Apple Silicon)
succeeded Jun 11, 2026 in 1h 32m 31s