Skip to content

[Enhancement] Extend quantization support to InfuseNet via --infusenet_quant (NF4,FP8,INT8,INT4)#49

Open
dzhengAP wants to merge 2 commits into
bytedance:mainfrom
dzhengAP:feat/infusenet-quantization
Open

[Enhancement] Extend quantization support to InfuseNet via --infusenet_quant (NF4,FP8,INT8,INT4)#49
dzhengAP wants to merge 2 commits into
bytedance:mainfrom
dzhengAP:feat/infusenet-quantization

Add --infusenet_quant {nf4,fp8,int8,int4} for independent InfuseNet q…

1e7a3bc
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs