Skip to content

add northflank to benchmarks#122

Open
kisernl wants to merge 1 commit into
masterfrom
add-northflank
Open

add northflank to benchmarks#122
kisernl wants to merge 1 commit into
masterfrom
add-northflank

Conversation

@kisernl
Copy link
Copy Markdown
Collaborator

@kisernl kisernl commented May 29, 2026

This pull request enables support for the northflank provider in both the sandbox benchmark workflow and the application code. The changes ensure that northflank is now included as an active provider, with its required environment variables properly set up.

@open-cla
Copy link
Copy Markdown

open-cla Bot commented May 29, 2026

Contributor License Agreement

All contributors are covered by a CLA.

@github-actions
Copy link
Copy Markdown
Contributor

Sandbox Benchmark Results

Sequential

# Provider Score Median TTI P95 P99 Status
1 declaw 99.0 0.06s 0.16s 0.16s 10/10
2 tensorlake 96.3 0.22s 0.60s 0.60s 10/10
3 upstash 95.4 0.39s 0.55s 0.55s 10/10
4 daytona 94.8 0.36s 0.77s 0.77s 10/10
5 e2b 94.4 0.46s 0.70s 0.70s 10/10
6 archil 94.2 0.43s 0.80s 0.80s 10/10
7 blaxel 94.0 0.58s 0.63s 0.63s 10/10
8 vercel 91.6 0.73s 1.01s 1.01s 10/10
9 modal 83.4 1.24s 2.29s 2.29s 10/10
10 hopx 82.1 1.69s 1.94s 1.94s 10/10
11 runloop 82.0 0.74s 3.40s 3.40s 10/10
12 cloudflare 78.9 1.85s 2.50s 2.50s 10/10
13 codesandbox 42.2 2.97s 22.89s 22.89s 10/10
14 northflank 30.8 5.33s 9.30s 9.30s 10/10
15 namespace 0.0 0.00s 0.00s 0.00s 0/10

Staggered

# Provider Score Median TTI P95 P99 Status
1 declaw 99.4 0.05s 0.08s 0.08s 10/10
2 tensorlake 97.8 0.21s 0.24s 0.24s 10/10
3 archil 95.9 0.33s 0.54s 0.54s 10/10
4 daytona 95.1 0.33s 0.74s 0.74s 10/10
5 blaxel 94.0 0.57s 0.64s 0.64s 10/10
6 e2b 93.5 0.47s 0.91s 0.91s 10/10
7 upstash 92.5 0.51s 1.11s 1.11s 10/10
8 runloop 92.5 0.71s 0.81s 0.81s 10/10
9 vercel 91.0 0.71s 1.19s 1.19s 10/10
10 hopx 84.0 1.45s 1.81s 1.81s 10/10
11 modal 79.2 1.32s 3.22s 3.22s 10/10
12 cloudflare 77.8 1.78s 2.88s 2.88s 10/10
13 codesandbox 69.3 2.89s 3.34s 3.34s 10/10
14 northflank 29.8 6.72s 7.46s 7.46s 10/10
15 namespace 0.0 0.00s 0.00s 0.00s 0/10

Burst

# Provider Score Median TTI P95 P99 Status
1 declaw 99.1 0.09s 0.11s 0.11s 10/10
2 tensorlake 97.2 0.27s 0.30s 0.30s 10/10
3 upstash 95.1 0.49s 0.50s 0.50s 10/10
4 daytona 94.8 0.36s 0.76s 0.76s 10/10
5 archil 94.8 0.40s 0.70s 0.70s 10/10
6 blaxel 94.0 0.59s 0.62s 0.62s 10/10
7 e2b 93.1 0.51s 0.95s 0.95s 10/10
8 runloop 92.5 0.71s 0.83s 0.83s 10/10
9 vercel 92.1 0.65s 1.01s 1.01s 10/10
10 modal 82.8 1.43s 2.16s 2.16s 10/10
11 cloudflare 80.7 1.61s 2.40s 2.40s 10/10
12 hopx 72.8 2.00s 3.79s 3.79s 10/10
13 codesandbox 68.5 2.85s 3.58s 3.58s 10/10
14 northflank 41.0 5.11s 7.08s 7.08s 10/10
15 namespace 0.0 0.00s 0.00s 0.00s 0/10

View full run · SVGs available as build artifacts

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant