merge initial public release into main - #12

Merged

meganfrisella merged 115 commits into

mainfrom

Jun 9, 2026

Commits on Nov 26, 2025

Rebased
pgusto34
committed
4a60b94
WIP
pgusto34
committed
ebee722
Updated requirements.txt
pgusto34
committed
88a2eaf
stencil backwards_compile task on StageActor captures a partial backward graph

meganfrisella
authored and
pgusto34
committed
c766869
Rebased
pgusto34
committed
3040164
WIP
pgusto34
committed
0b16c7b
Updated requirements.txt
pgusto34
committed
8157cd7
Split backwards example script
pgusto34
committed
c272be4
Removed requirements.txt file and updated README in place of it
pgusto34
committed
ea2139e
Graph PNGs
pgusto34
committed
65952d5

Commits on Dec 1, 2025

Commented out NCCL
pgusto34
committed
c3f6979
Merged changes
pgusto34
committed
9330880
Merge remote-tracking branch 'refs/remotes/origin/ZeroBubble' into ZeroBubble
pgusto34
committed
756febe

Commits on Dec 9, 2025

Initial ZeroBubble implementation
pgusto34
committed
f5d1b63

Commits on Jan 14, 2026

Added graph pruning to optimize split backward pass for ZB, including a backward_utils.py file
pgusto34
committed
832385c

Commits on Jan 20, 2026

Merge remote-tracking branch 'origin/main' into ZeroBubble
Parker Gustafson
committed
995e7a7

Commits on Jan 21, 2026

Dockerfile and run.sh to deploy Piper in a container
pgusto34
committed
955d7b2

Commits on Jan 28, 2026

Commits on Feb 2, 2026

add centralized comm op scheduling and implement comm ops for DP gradient sync. llama experiment with PP=1 and DP=2 shows that comm is entirely overlapped with backward
meganfrisella
committed
e4e8b5b

Commits on Feb 10, 2026

a2a support for EP in Piper. Implemented with a graph transformation _insert_comm_ops that inserts a2a comm ops detected by user annotations with 'collective'='all_to_all_single'. Also changed stag…
meganfrisella
committed
11691b2

Commits on Feb 12, 2026

Commits on Feb 13, 2026

Revert "fix device-side assertion when running multiple iters"
meganfrisella
committed
cc6dda2
Reapply "fix device-side assertion when running multiple iters"
meganfrisella
committed
b6b8f48
Revert "remove input clear on actor"
meganfrisella
committed
c9cbd32
clean up test files and timing code
meganfrisella
committed
4e6054f
rm files
meganfrisella
committed
900348f
remove actor._forward requires_grad hack
meganfrisella
committed
d528f48
deadlock happens when --mbs > 1 due to p2p send/recv not ordered properly
meganfrisella
committed
51b47b1

Commits on Feb 18, 2026

manually reorder p2p ops for marked schedule tasks
meganfrisella
committed
789a2f5
merge
meganfrisella
committed
f25e515
Revert "merge"
meganfrisella
committed
e4b3372
Order P2P ops
AndyUB
authored
4db0979
use comp stream for fwd/bwd computation
meganfrisella
committed
92ace46

Commits on Feb 19, 2026

Commits on Feb 20, 2026

Merge remote-tracking branch 'origin/main' into ZeroBubble
pgusto34
committed
995b676
Refactoring from /src to /piper
pgusto34
committed
e6e32dd
dag schedules instead of 2D array with graph visualization
meganfrisella
committed
21ec388
verify p2p correctness: execution matches schedule
AndyUB
committed
ce765e9
Debugging Torch autograd error
pgusto34
committed
42fc7c7
add_param_group patch to fix split backward autograd issue
pgusto34
committed
274c0aa
fix: explicit send and recv tensors for fwd P2Ps
AndyUB
committed
dfab522
Reverted the stage_id != 0 check in forward to match main
pgusto34
committed
13bd51d

Commits on Feb 22, 2026

p2p ordering test v0
AndyUB
committed
78a61d5

Commits on Feb 23, 2026

Commits on Feb 24, 2026

Commits on Feb 25, 2026

Commits on Feb 26, 2026

Merge ZB
meganfrisella
committed
60ce835
DualPipeV schedule with ZB
meganfrisella
committed
15a7525
fix: stream wait logic.
Conless
committed
0e22cca

Commits on Feb 27, 2026

Commits on Feb 28, 2026

Deferred Init Working
pgusto34
committed
778beda
Code cleanup for PR
pgusto34
committed
542413d

Commits on Mar 2, 2026

backward hook fix for split backwards pass
meganfrisella
committed
6faf0cd
merge deferred init
meganfrisella
committed
80346c0

Commits on Mar 3, 2026

integrate qwen with torch.ops workaround
sbhTWR
committed
4a52dfe
Merge remote-tracking branch 'origin/dualpipe_overlap' into moe_eval
sbhTWR
committed
cfdadd3

Commits on Mar 5, 2026

use cuda events to wait for recv in compute tasks rather than p2p tasks, separate p2p send vs recv thread (on a single communicator does not actually run on separate streams)
meganfrisella
committed
70fe692

Commits on Mar 6, 2026

Commits on Mar 9, 2026

Commits on Mar 10, 2026

integrate qwen model from torchtitan with workarounds
sbhTWR
committed
bc80f90
moe changes
sbhTWR
committed
752de6b
Merge remote-tracking branch 'origin/dualpipe_overlap' into moe_eval
sbhTWR
committed
69073a3
moe changes
sbhTWR
committed
3de94cc

Commits on Mar 11, 2026

enable bf16 support
meganfrisella
committed
77b4d77
enable bf16
sbhTWR
committed
da9c620
(WIP) split ZeRO1 and ZeRO2
AndyUB
committed
3a39f53
run ZeRO1 and ZeRO2 on LLAMA_DEBUG
AndyUB
committed
2c85e9c

Commits on Mar 12, 2026

Commits on Mar 24, 2026

Commits on Mar 25, 2026

Commits on Mar 31, 2026

slow startup time fix: use 2 pp communicators per pp group rather than 2 per pp rank pair. also limit model compilation to a single dp rank in the case DP > 1. other changes reflect deepseek overla…
meganfrisella
committed
4460cb4

Commits on Apr 9, 2026

Change pipeline schedule interface (no None entries required, use logical time steps instead. refactor PiperActor so that all intermediate storage is managed by run_dag, and the actual compute/comm…
meganfrisella
committed
7c7a9fd

Commits on Apr 13, 2026

add per-bucket AC (split buckets into N ac segments). revert flat param buffer back to single buffer per trainable param to avoid cuda memory bug. implement optional a2a_ar_no_overlap to avoid EP/D…
meganfrisella
committed
70e7bdc

Commits on Apr 14, 2026

Commits on Apr 15, 2026

zero overlapping performance debugging
meganfrisella
committed
2c6c637

Commits on Apr 16, 2026

flash attention backend for qwen. update sweep scripts
meganfrisella
committed
12aaabe

Commits on Apr 19, 2026

implement chunk overlapping
meganfrisella
committed
ddc8a35
update zero e2e script
meganfrisella
committed
a5e1387
typo
meganfrisella
committed
8655cb6
adjust run_dag priorities
meganfrisella
committed
3674a50

Commits on Apr 22, 2026

zero2 startup memory fix
sbhTWR
committed
655a42d

Commits on Apr 23, 2026

enable pp to be the outer dimension
Conless
committed
05c196c
add nsight backtrace to runtime env
meganfrisella
committed
18a7f07
meerge remote-tracking branch 'origin/dev-yi' into dag-ir
meganfrisella
committed
18a48ce

Commits on Jun 1, 2026

debug schedule directives
meganfrisella
committed
303c7ed
refactor
meganfrisella
committed
8d851b3

Commits on Jun 3, 2026

artifact dir with commands to run eval
meganfrisella
committed
bbd4ae8

Commits on Jun 9, 2026

initial release
meganfrisella
committed
0c252c7