GitHub - local-inference-lab/quant-toolkit

Ask your friendly neighborhood AI agent how to use this.

Name		Name	Last commit message	Last commit date
Latest commit History 15 Commits
configs		configs
data		data
models		models
scripts		scripts
tools		tools
.gitattributes		.gitattributes
.gitignore		.gitignore
README.md		README.md
export_hf.py		export_hf.py
moe_registry.py		moe_registry.py
pyproject.toml		pyproject.toml
quantize.py		quantize.py
streaming_loader.py		streaming_loader.py
transformers_compat.py		transformers_compat.py

Provide feedback