Skip to content

Add Pareto frontier chart to Harbor-Index blog - #1

Merged
linhaowei1 merged 5 commits into
linhaowei1:blog/harbor-indexfrom
crystalxyz:add-pareto-frontier-chart
Jul 1, 2026
Merged

Add Pareto frontier chart to Harbor-Index blog#1
linhaowei1 merged 5 commits into
linhaowei1:blog/harbor-indexfrom
crystalxyz:add-pareto-frontier-chart

Conversation

@crystalxyz

Copy link
Copy Markdown

Targets the blog/harbor-index branch behind PR harbor-framework#60 so this folds into that WIP blog.

What this adds

  • components/harbor-index-pareto-chart.tsx — a recharts ComposedChart scaffold for a cost-vs-pass-rate Pareto frontier: $0–$1000 cost X axis, 0–30% pass-rate Y axis, dashed CartesianGrid, a dashed frontier Line, and two logo-dot Scatter series (mini vs. standard models). Isolated "use client" file so it doesn't change the rendering boundary of the existing server-rendered charts.
  • content/blog/harbor-index.mdx — imports the component and drops it into a new Cost efficiency analysis section.

Status

The chart is an empty frame for now — the frontierData / miniModels / standardModels arrays are intentionally empty (with the expected { label, cost, score, logoUrl } shape documented) so the numbers can be filled in once the cost-reconstruction is final. Renders cleanly in bun dev at HTTP 200 with no type/lint errors.

🤖 Generated with Claude Code

@crystalxyz
crystalxyz force-pushed the add-pareto-frontier-chart branch from e459cbe to 2fd19e5 Compare June 30, 2026 15:21
Plots avg cost per trial against Harbor-Index pass rate for all 18
agent-model pairs, with the 7 cost-optimal points traced by a smooth
monotone frontier line that draws in left-to-right when scrolled into view.
Each point is a provider logo chip: solid border for native CLI, dotted for
Terminus 2, with a brand-colored boundary per provider. Off-frontier models
are greyed so the frontier stays prominent. Cost axis is log-scaled, and
hovering a chip shows the model, cost, and pass rate.

Data from analysis/token/outputs/08_harbor_index_pareto.csv in
harbor-adapters-experiments (cost = avg_cost_per_trial_usd, score =
score_pct, frontier = on_frontier). Provider logos under public/logos.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
@crystalxyz
crystalxyz force-pushed the add-pareto-frontier-chart branch from 2fd19e5 to d22ca2c Compare June 30, 2026 16:53
crystalxyz and others added 4 commits July 1, 2026 10:58
…pareto-frontier-chart

# Conflicts:
#	content/blog/harbor-index.mdx
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
A right-rail 'On this page' menu (xl+ screens) built on fumadocs'
AnchorProvider/TOCItem, with active-section highlighting. Scoped to
the harbor-index slug so other news posts are unchanged.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Place the cost/pass-rate Pareto chart right after the intro (before the
pass-rate leaderboard) and drop the separate 'Cost efficiency analysis'
subsection from Findings.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
@linhaowei1
linhaowei1 merged commit 062eb86 into linhaowei1:blog/harbor-index Jul 1, 2026
linhaowei1 pushed a commit that referenced this pull request Jul 3, 2026
Harbor-Index blog: Findings restructure, unified pastel palette, citations, copy polish
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants