Skip to content

⚡ Bolt: 8-bit Dynamic Quantization for LLM Inference#52

Draft
hombredennis66 wants to merge 1 commit into
mainfrom
bolt-llm-quantization-900290204387624004
Draft

⚡ Bolt: 8-bit Dynamic Quantization for LLM Inference#52
hombredennis66 wants to merge 1 commit into
mainfrom
bolt-llm-quantization-900290204387624004

perf(llm): implement 8-bit dynamic quantization and inference_mode

a85a0ce
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar