Add monolithic fused packet allreduce kernel and Model::all_reduce_packet API#254

Merged

chhwang merged 10 commits into

mainfrom

pr-d-fused-packet-allreduce

Jun 10, 2026

Commits on Jun 9, 2026

ark-dev: Fix ring all-reduce in-place corruption at gpu_num ≥ 3 by copying input into a private buffer before the loop.
ark-dev
committed
ark-dev: Fix ring all-reduce in-place corruption at gpu_num ≥ 3: detect buffer aliasing and copy input into a private tensor before the ring loop.
ark-dev
committed
ark-dev: Fix clang-format violations in ark/unittest/unittest_utils.h UNITTEST_SKIP macro (trailing whitespace) to pass PR #253 linter CI.
ark-dev
committed
ark-dev: Fix clang-format violation in ark/unittest/unittest_utils.h (trailing whitespace / misaligned backslash in UNITTEST_SKIP macro) to pass the linters check on PR #253.
ark-dev
committed
ark-dev: Port mscclpp fused packet allreduce into ARK: monolithic allreducePacket CUDA kernel replacing the 3-op decomposition, including all_reduce_packet method stripped from P4.
ark-dev
committed

Commits on Jun 10, 2026