Skip to content

⚡ Bolt: LLM Inference Optimization with Dynamic Quantization#45

Draft
hombredennis66 wants to merge 1 commit into
mainfrom
bolt-quantization-optimization-7516947855358784739
Draft

⚡ Bolt: LLM Inference Optimization with Dynamic Quantization#45
hombredennis66 wants to merge 1 commit into
mainfrom
bolt-quantization-optimization-7516947855358784739

⚡ Bolt: Optimize LLM inference with 8-bit dynamic quantization

6b551a8
Select commit
Loading
Failed to load commit list.