feat(comm): add copy-engine selected-record exchange with bulk layer packets#3
Draft
FujitsuPolycom wants to merge 1 commit into
Draft
Conversation
Add single-plane and three-plane CUDA-IPC copy-engine exchange with rotated peer scheduling, bounded slab overlays, graph-safe deferred release, and large-offset coverage. Co-authored-by: OpenAI Codex <codex@openai.com> Signed-off-by: FujitsuPolycom <87842395+FujitsuPolycom@users.noreply.github.com>
FujitsuPolycom
force-pushed
the
codex/selected-record-ce-exchange
branch
from
July 21, 2026 04:24
22292a4 to
68a4502
Compare
FujitsuPolycom
force-pushed
the
codex/sparse-ckv-p2p-transport
branch
from
July 21, 2026 04:24
a7ebc4b to
f3d5c14
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Adds a generic copy-engine transport for sparse fixed-width records.
exchange()moves one compact record plane.exchange_layers()packs three planes with one destination map, performs onerank-rotated peer DMA sequence and one arrival barrier, then unpacks into
caller-owned outputs.
protocol and can alternate on one stream.
The public API is
sparkinfer.comm.pcie.SelectedRecordCopyExchange. This PR isstacked on the direct selected-record transport so both implementations remain
independently reviewable.
Sparkinfer rebase
The branch is based on
local-inference-lab/sparkinfer@ec2cd4d; all runtime,JIT, packaging, and test paths use the new
sparkinfer.comm.pcienamespace.Validation
Performance context
The dependent vLLM integration groups GLM S1/S2/S3 selected-record prefetches
into one exchange. Against the same-image per-layer CE control:
Operational contract
AI-assisted implementation under human direction; the diff and validation
results were reviewed before publication.
Design document
GLM-5.2 Sparse CKV under Decode Context Parallelism is the canonical architecture, transport-contract, validation, and upstream-decomposition reference for this PR stack.