Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .github/ISSUE_TEMPLATE/config.yml
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
blank_issues_enabled: false
contact_links:
- name: Security vulnerability (private report)
url: https://github.com/oxageninc/arena/security/advisories/new
url: https://github.com/macanderson/arena/security/advisories/new
about: Report security issues privately via GitHub Security Advisories — do NOT open a public issue. See SECURITY.md.
4 changes: 2 additions & 2 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -52,5 +52,5 @@ CLIs, engineered to survive scrutiny.
Dependabot, and a dependency-review gate that blocks known-vulnerable PRs.
- `SECURITY.md` with a private vulnerability reporting channel.

[Unreleased]: https://github.com/oxageninc/arena/compare/5122005...HEAD
[0.1.0]: https://github.com/oxageninc/arena/releases/tag/v0.1.0
[Unreleased]: https://github.com/macanderson/arena/compare/5122005...HEAD
[0.1.0]: https://github.com/macanderson/arena/releases/tag/v0.1.0
4 changes: 2 additions & 2 deletions CONTRIBUTING.md
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,7 @@ each undermine the one thing the project exists to provide.

## Before you write code

- **Search [open issues](https://github.com/oxageninc/arena/issues) first** —
- **Search [open issues](https://github.com/macanderson/arena/issues) first** —
someone may already be on it.
- For anything non-trivial (new adapter, new task, stat/report change), **open
an issue** and sketch the approach before investing in code. A 5-minute
Expand All @@ -21,7 +21,7 @@ each undermine the one thing the project exists to provide.
Arena needs **Node 22+** and **pnpm** (the CI pins pnpm 11):

```bash
git clone https://github.com/oxageninc/arena
git clone https://github.com/macanderson/arena
cd arena
pnpm install
pnpm typecheck
Expand Down
10 changes: 5 additions & 5 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -5,16 +5,16 @@

# Arena

[![CI](https://github.com/oxageninc/arena/actions/workflows/ci.yml/badge.svg?branch=main)](https://github.com/oxageninc/arena/actions/workflows/ci.yml)
[![CI](https://github.com/macanderson/arena/actions/workflows/ci.yml/badge.svg?branch=main)](https://github.com/macanderson/arena/actions/workflows/ci.yml)
[![license](https://img.shields.io/badge/license-MIT-blue.svg)](LICENSE)
[![OpenSSF Scorecard](https://api.scorecard.dev/projects/github.com/oxageninc/arena/badge)](https://scorecard.dev/viewer/?uri=github.com/oxageninc/arena)
[![OpenSSF Scorecard](https://api.scorecard.dev/projects/github.com/macanderson/arena/badge)](https://scorecard.dev/viewer/?uri=github.com/macanderson/arena)

**Head-to-head benchmarks for agentic coding CLIs — built to survive scrutiny.** · [arena.oxagen.sh](https://arena.oxagen.sh)

Arena runs two or more coding agents (Claude Code, Gemini CLI, [Oxagen](https://oxagen.sh), [Stella](https://github.com/oxageninc/stella), or your own) on the **same tasks, same model, same budget, same timeout**, grades them with **held-out tests the agent can never see or author**, and reports each metric separately with real statistics and full receipts.
Arena runs two or more coding agents (Claude Code, Gemini CLI, [Oxagen](https://oxagen.sh), [Stella](https://github.com/macanderson/stella), or your own) on the **same tasks, same model, same budget, same timeout**, grades them with **held-out tests the agent can never see or author**, and reports each metric separately with real statistics and full receipts.

```bash
git clone https://github.com/oxageninc/arena
git clone https://github.com/macanderson/arena
cd arena && pnpm install

pnpm arena doctor # which agent CLIs are installed?
Expand Down Expand Up @@ -139,7 +139,7 @@ Contributions welcome — see [CONTRIBUTING.md](CONTRIBUTING.md) (adding an
adapter or task fixture is a great first PR). We also have a
[Code of Conduct](.github/CODE_OF_CONDUCT.md) and a
[changelog](CHANGELOG.md). Report security issues privately via the repo's
[Security tab](https://github.com/oxageninc/arena/security/advisories/new) — not
[Security tab](https://github.com/macanderson/arena/security/advisories/new) — not
as a public issue.

MIT © Mac Anderson
2 changes: 1 addition & 1 deletion SECURITY.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@

Please **do not** open a public issue for security vulnerabilities.

Report privately via GitHub's [**Report a vulnerability**](https://github.com/oxageninc/arena/security/advisories/new) button on the repository's Security tab (Security → Advisories → Report a vulnerability). This opens a private channel with the maintainers.
Report privately via GitHub's [**Report a vulnerability**](https://github.com/macanderson/arena/security/advisories/new) button on the repository's Security tab (Security → Advisories → Report a vulnerability). This opens a private channel with the maintainers.

We aim to acknowledge reports within 3 business days and to ship a fix or mitigation for confirmed high-severity issues as quickly as is practical. We'll coordinate a disclosure timeline with you and credit you in the advisory unless you prefer otherwise.

Expand Down
4 changes: 2 additions & 2 deletions harbor/pyproject.toml
Original file line number Diff line number Diff line change
Expand Up @@ -29,8 +29,8 @@ dependencies = [
dev = ["pytest>=7.0", "pytest-asyncio>=0.21", "ruff>=0.8"]

[project.urls]
Homepage = "https://github.com/oxageninc/arena"
Repository = "https://github.com/oxageninc/arena"
Homepage = "https://github.com/macanderson/arena"
Repository = "https://github.com/macanderson/arena"

[tool.setuptools]
packages = ["arena_harbor"]
Expand Down
2 changes: 1 addition & 1 deletion package.json
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@
"type": "module",
"repository": {
"type": "git",
"url": "https://github.com/oxageninc/arena.git"
"url": "https://github.com/macanderson/arena.git"
},
"keywords": [
"benchmark",
Expand Down
10 changes: 5 additions & 5 deletions web/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -32,7 +32,7 @@
<a href="#method">Method</a>
<a href="#agents">Agents</a>
<a href="#harbor">Harbor</a>
<a class="pill" href="https://github.com/oxageninc/arena">GitHub</a>
<a class="pill" href="https://github.com/macanderson/arena">GitHub</a>
</nav>
</div>
</header>
Expand All @@ -54,12 +54,12 @@ <h1>Head-to-head benchmarks for agentic coding CLIs — built to survive scrutin
is reported separately, with real statistics and full receipts.
</p>
<div class="hero-actions">
<a class="pill pill--solid" href="https://github.com/oxageninc/arena">View on GitHub</a>
<a class="pill" href="https://github.com/oxageninc/arena/blob/main/METHODOLOGY.md">Read the methodology</a>
<a class="pill pill--solid" href="https://github.com/macanderson/arena">View on GitHub</a>
<a class="pill" href="https://github.com/macanderson/arena/blob/main/METHODOLOGY.md">Read the methodology</a>
</div>
<div class="terminal" role="figure" aria-label="Quick start commands">
<pre><span class="cmt"># the only comparison that isolates the harness: same model everywhere</span>
<span class="prompt">$</span> git clone https://github.com/oxageninc/arena &amp;&amp; cd arena &amp;&amp; pnpm install
<span class="prompt">$</span> git clone https://github.com/macanderson/arena &amp;&amp; cd arena &amp;&amp; pnpm install
<span class="prompt">$</span> pnpm arena run --agents oxagen,claude-code \
--model anthropic/claude-sonnet-5 --trials 3 --budget 5
<span class="prompt">$</span> open results/run-*/report.md</pre>
Expand Down Expand Up @@ -317,7 +317,7 @@ <h2>Before you publish a number</h2>
<div class="wrap">
<p class="tagline">Same model. Same budget. Same timeout. Full receipts.</p>
<p>
<a href="https://github.com/oxageninc/arena">github.com/oxageninc/arena</a>
<a href="https://github.com/macanderson/arena">github.com/macanderson/arena</a>
· MIT · an <a href="https://oxagen.sh">Oxagen</a> project
</p>
</div>
Expand Down