Prefill/decode disaggregation design#116

Merged

dennis-upbound merged 10 commits into

mainfrom

dennis/disagg-design

Jun 11, 2026

Commits on Jun 10, 2026

Address design review feedback on disaggregation

dennis-upbound
and
claude
committed
Fold the confirmed disaggregation routing design into the doc

dennis-upbound
and
claude
committed
Explain InferencePool, the gateway choice, and the role labels

dennis-upbound
and
claude
committed
Reflect the 1:1 default ratio and fix the NIC count in the example

dennis-upbound
and
claude
committed
Frame the gateway as a pluggable default, not a least-change choice
dennis-upbound
committed
Make routing a first-class explicit block; require explicit counts

dennis-upbound
and
claude
committed