ZeroGPU Router

Cut inference costs without dumbing down your agent.
Route summarize, classify, PII redaction, JSON extraction, follow-ups, and short chat to small/nano models via MCP — hosted at https://mcp.zerogpu.ai/mcp.

 

What is ZeroGPU Router?

ZeroGPU Router is a smart task router for AI agents. It exposes task-specific tools — summarize, classify, redact PII, extract JSON, and more — via the Model Context Protocol (MCP), backed by small language models that run for a fraction of the cost of a frontier model.

Your agent keeps doing the heavy reasoning. The boring stuff gets routed to ZeroGPU.

• OpenClaw — install zerogpu-openclaw-plugin and register MCP in OpenClaw (see agents/openclaw/); package name and plugin id match.
• Claude Code — no MCP setup. Install the zerogpu CLI plus the marketplace plugin and you get 11 auto-invoked skills plus a cost-savings readout (see agents/claude/).
• Cheap by default — small models for trivial work, frontier model untouched for everything else.
• Per-call savings — every routed task returns model, latency, and a real savings_usd figure.
• Hosted, no infra — point your agent at https://mcp.zerogpu.ai/mcp. We run the routing layer.

OpenClaw quick start

You need a ZeroGPU API key and project ID. Grab them at platform.zerogpu.ai.

Install the plugin (zerogpu-openclaw-plugin):

From npm (one command):

openclaw plugins install npm:zerogpu-openclaw-plugin

Pin a release: npm:zerogpu-openclaw-plugin@0.1.10.

From GitHub — OpenClaw supports git:github.com/<owner>/<repo>@<ref>, but this repo is a monorepo: the plugin package is at agents/openclaw/plugin/, not the repository root, so git:github.com/zerogpu/zerogpu-router@main will not install correctly. Clone and install that folder instead (pin main or a tag with -b):

tmpdir=$(mktemp -d)
git clone --depth 1 -b main https://github.com/zerogpu/zerogpu-router.git "$tmpdir/repo"
(cd "$tmpdir/repo/agents/openclaw/plugin" && npm ci && npm run build)
openclaw plugins install "$tmpdir/repo/agents/openclaw/plugin"

Connect OpenClaw to MCP:

openclaw mcp set zerogpu '{
  "url": "https://mcp.zerogpu.ai/mcp",
  "transport": "streamable-http",
  "headers": {
    "x-api-key": "zgpu-api-…",
    "x-project-id": "id"
  }
}'

Restart Gateway:

openclaw gateway restart

Try:

summarize this paragraph: Renewable energy adoption is accelerating globally, driven by falling solar and wind costs.

The agent should call zerogpu_summarize and return a summary plus savings metadata.

Claude Code quick start

The Claude Code plugin ships 14 skills — 11 inference skills that Claude auto-invokes when your request matches ("summarize this", "redact the PII", "classify by sentiment and topic"), plus the manual signin, status, and cost-savings skills. You can also call any skill manually with /zerogpu-router:<name>. Run /zerogpu-router:cost-savings anytime to see how much you've saved by routing trivial work to ZeroGPU.

Grab a ZeroGPU API key and project ID at platform.zerogpu.ai, then:

1. Install the zerogpu CLI (the plugin shells out to it):

npm install -g zerogpu-cli

2. Authenticate:

zerogpu login

You'll be prompted for your API key (zgpu-api-…) and project ID (UUID).

3. Install the Claude Code plugin — start a Claude Code session by running claude in your terminal, then:

/plugin marketplace add zerogpu/zerogpu-router
/plugin install zerogpu-router@zerogpu
/reload-plugins

4. Try it:

Redact PII from this support ticket before I paste it into our public bug tracker:

Hi team — this is Sarah Chen (sarah.chen@northwind-labs.com, +1 415-555-0182).
Our prod database started throwing connection timeouts around 2:14 AM PT last
night. The on-call engineer Marcus Rivera (slack: @mrivera) restarted the
pgbouncer pod but the issue came back within 20 minutes. Billing should go to
our CFO Priya Patel at priya.patel@northwind-labs.com, billing address 1455
Market St, Suite 600, San Francisco, CA 94103. Please call me back at the
number above.

Claude routes to /zerogpu-router:redact-pii automatically and returns the same passage with names, emails, phone numbers, social handles, and street addresses replaced by uppercase label placeholders like [PERSON], [EMAIL], [PHONE_NUMBER], [ADDRESS] — safe to paste into a public tracker. The gliner-multi-pii-v1 edge model does the masking, not Claude, so the raw PII never enters Claude's context window.

The model is tuned for the standard PII categories above. Project-specific identifiers (internal hostnames, IPs, contract numbers, card last-fours) won't be caught — strip those yourself, or pipe the result through /zerogpu-router:extract-entities with your own custom labels.

Full walkthrough — prerequisites, every skill documented in detail, troubleshooting: agents/claude/README.md.

Cloud connection

Sign in at platform.zerogpu.ai to:

• Generate API keys and project IDs
• Watch live token usage, latency, and routed-call savings on the dashboard
• See per-tool savings broken down by agent and time range
• Manage agents, billing, and team access
• Follow setup for your stack: OpenClaw (MCP-based) vs Claude Code (CLI + plugin, no MCP)

The hosted Router at https://mcp.zerogpu.ai/mcp is the one your agent talks to. The dashboard at platform.zerogpu.ai is where you see what it did.

Routes

ZeroGPU Router exposes eleven task-specific routes:

Route	Workload	Model
zerogpu_classify_iab	IAB topic classification	zlm-v1-iab-classify-edge
zerogpu_summarize	TL;DRs, abstracts, meeting note summaries	t5-small
zerogpu_classify_zero_shot	Classify against a flat label list	deberta-v3-small
zerogpu_extract_entities	Extract people, places, companies, dates, custom entities	gliner2-base-v1
zerogpu_extract_json	Pull structured fields into grouped JSON	gliner2-base-v1
zerogpu_classify_structured	Multi-axis schema classification	gliner2-base-v1
zerogpu_redact_pii	Mask emails, phones, names, addresses, other PII	gliner-multi-pii-v1
zerogpu_extract_pii	Extract PII grouped by category	gliner-multi-pii-v1
zerogpu_generate_followups	Generate follow-up questions from a passage	zlm-v1-followup-questions-edge
zerogpu_chat	Short small-model chat replies	LFM2.5-1.2B-Instruct / -Thinking
zerogpu_health	Verify ZeroGPU backend health	—

Every route returns { <task fields>, model, usage, savings }.

Packages

Package	Role
agents/openclaw/	OpenClaw: package + plugin id zerogpu-openclaw-plugin + skill + MCP registration JSON
agents/claude/	Claude Code: zerogpu-cli + marketplace plugin (/plugin install zerogpu-router@zerogpu) — no MCP setup

Quick Links

• OpenClaw setup
• Agent integrations index
• Claude Code setup
• Platform dashboard
• Release guide
• Contributing
• Security
• License