Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
23 changes: 23 additions & 0 deletions src/code/issue1/README-2026.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,23 @@
# Issue 1 单机可完成部分:DeepEP SM/QP 预算模型

`sm_qp_budget.py` 是 DeepEP V2 `ElasticBuffer.get_theoretical_num_sms()` 与
`get_theoretical_num_qps()` 的独立复现,保留以下关键逻辑:

- 用组合数估计 top-k 命中的不同 EP/scale-out rank 数;
- 显式累计 SM read/write、RDMA、NVLink 归一化流量;
- 识别瓶颈链路并由每 SM 读写带宽反推 SM 数;
- 乘 1.25 安全系数、偶数对齐、4 SM 下限和设备上限;
- direct QP=`min(num_sms, 9)`,hybrid QP=`num_sms*16+1`,最后受已分配 QP 限制。

对照源码:`deepseek-ai/DeepEP` commit
`dd758caf451848bd150e1046af3d0a73e5fff38d` 的
`deep_ep/buffers/elastic.py`。

```bash
python -m pytest src/code/issue1/test_sm_qp_budget.py
python src/code/issue1/sm_qp_budget.py
```

默认输出 1/2/4/8 节点、top-k 1/2/4/8 的 JSON 与 CSV。带宽参数是可替换输入;
最终仍需在目标 DeepEP 多机环境扫描 SM 数,验证预测值能保持实测最优带宽的 95% 以上。

17 changes: 17 additions & 0 deletions src/code/issue1/results/sm_qp_budget.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,17 @@
nodes,ranks,topk,expected_distinct_ranks,bottleneck,raw_sms,recommended_sms,recommended_qps,sm_saved_vs_fixed_24
1,8,1,1.0,nvlink,10.285714285714286,14,129,10
1,8,2,1.8888888888888893,nvlink,10.285714285714286,14,129,10
1,8,4,3.375462718138551,nvlink,10.285714285714286,14,129,10
1,8,8,5.432551281938457,nvlink,10.285714285714286,14,129,10
2,16,1,1.0,rdma,5.0,8,129,16
2,16,2,1.9523809523809526,rdma,4.915789473684211,8,129,16
2,16,4,3.720404925587369,rdma,6.003590161090127,8,129,16
2,16,8,6.750925436277102,rdma,8.76938854208264,12,129,12
4,32,1,1.0,rdma,3.0,4,65,20
4,32,2,1.9841269841269842,rdma,2.591591591591592,4,65,20
4,32,4,3.904761904761905,rdma,2.689954839275614,4,65,20
4,32,8,7.555555555555557,rdma,3.450977290315941,6,97,18
8,64,1,1.0,rdma,2.428571428571429,4,65,20
8,64,2,2.0,rdma,1.9579831932773104,4,65,20
8,64,4,4.0,rdma,1.8357467379870638,4,65,20
8,64,8,8.0,rdma,2.036205912506329,4,65,20
Loading