Skip to content

RFC: Use torch.compile to reduce Python overhead - #73

Closed
gau-nernst wants to merge 6 commits into
mingfeima:cpu_opt_ww11from
gau-nernst:cpu_compile
Closed

RFC: Use torch.compile to reduce Python overhead#73
gau-nernst wants to merge 6 commits into
mingfeima:cpu_opt_ww11from
gau-nernst:cpu_compile

support tensor-parallel

630db4d
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs