Skip to content

feat: Added benchmarks for agent-sdk-go performance and scale testing#21

Merged
vinodvx merged 2 commits into
mainfrom
feat/benchmarks
Jun 7, 2026
Merged

feat: Added benchmarks for agent-sdk-go performance and scale testing#21
vinodvx merged 2 commits into
mainfrom
feat/benchmarks

Conversation

@vinodvx

@vinodvx vinodvx commented Jun 7, 2026

Copy link
Copy Markdown
Contributor

Description

Adds a config-driven benchmark suite under benchmarks/ to measure agent-sdk-go performance (latency, memory, CPU, tokens, success rate) using real pkg/agent runs with mock LLM and tools.

Highlights

  • YAML config for runtime (local/temporal), runs, concurrency, tools, sub-agents, logging, and reports
  • Optional external Temporal workers and shared setup for agent/worker fingerprint alignment
  • JSON/text reports and optional SDK logs for debugging

Test plan

  • go run ./benchmarks/ with default config.yaml (local runtime)
  • Run with runtime: temporal and Temporal server up
  • Verify reports under benchmarks/reports/ and logs when logger.enabled: true

Type of change

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to change)
  • Documentation update
  • Refactor / chore

Related issues

Close #20

Checklist

  • I have run make lint and make test locally
  • I have run make tidy if I added or removed dependencies
  • Commit messages follow conventional commits (e.g. feat:, fix:, docs:)
  • I have added/updated tests for my changes
  • Documentation is updated if needed

@codecov

codecov Bot commented Jun 7, 2026

Copy link
Copy Markdown

@vinodvx vinodvx merged commit 377531a into main Jun 7, 2026
4 of 5 checks passed
@vinodvx vinodvx deleted the feat/benchmarks branch June 7, 2026 08:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Benchmarks: Config-driven agent benchmark runner

1 participant