Skip to content

update benchmark results from gcp c2-standard-8 - #113

Merged
kacy merged 1 commit into
mainfrom
update-benchmark-results
Feb 12, 2026
Merged

update benchmark results from gcp c2-standard-8#113
kacy merged 1 commit into
mainfrom
update-benchmark-results

Conversation

@kacy

@kacy kacy commented Feb 12, 2026

Copy link
Copy Markdown
Owner

summary

updated benchmark results in README.md and bench/README.md following the sharded mode pipeline throughput optimization (#112). all results from a fresh GCP c2-standard-8 (8 vCPU Intel Xeon @ 3.10GHz), Ubuntu 22.04.

key improvements for sharded mode (redis-benchmark):

  • SET P=16: 799k → 1.25M ops/sec (+57%)
  • GET P=16: 799k → 1.57M ops/sec (+96%)
  • sharded now beats redis at all test points (1.3-1.4x)
  • concurrent-vs-sharded gap shrunk from ~2x to ~1.4x

what was tested

ran the full benchmark suite on a dedicated GCP VM:

  • bench/compare-redis.sh — redis-benchmark throughput (ember concurrent, ember sharded, redis, dragonfly)
  • bench/bench-memtier.sh — memtier throughput + latency (all four servers)
  • bench/bench-memory.sh — memory per key comparison

design considerations

sharded SET throughput under memtier pipelining shows lower numbers than redis-benchmark due to a known interaction between the dispatch-collect pipeline and memtier's connection pattern. GET, mixed workloads, and P=1 are unaffected. redis-benchmark results are more representative for SET-heavy workloads. noted in bench/README.md.

@kacy
kacy force-pushed the update-benchmark-results branch from 3399cf6 to b23fe9f Compare February 12, 2026 22:58
@kacy
kacy merged commit 5ce6d58 into main Feb 12, 2026
6 of 7 checks passed
@kacy
kacy deleted the update-benchmark-results branch February 12, 2026 23:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant