skill-tracker

Git-backed oversight of your Hermes Agents' skills.

Every skill_manage change to tracked skills is committed to git, with pull requests against the main branch for human review. You approve or reject those pull requests using the same git workflow you already know. Approved changes are merged and rebased back into each agent's local skill library; rejected changes are automatically reverted so the agent's "ground truth" stays aligned with your judgement.

skill-tracker shows you exactly how your agents' skills evolve over time, and lets you control what knowledge becomes accepted and shared among your agents.

Why?

Without skill-tracker, your agents modify their own skills silently — self-improvement loops patch them, the curator consolidates them, and direct agent actions edit them. None of this is visible, reviewed, or reversible. Changes accumulate invisibly, and bundled skills that get patched are silently frozen out of future updates.

skill-tracker makes every change visible, reviewable, and reversible — using the git workflow you already know.

How it works

skill-tracker uses a branch-per-agent model with a PR review workflow. Each agent always works from the HEAD of its own branch. As your agents work, the skill-tracker plugin intercepts every skill_manage tool call, immediately committing each change to the agent's branch. Related changes from each agent are automatically grouped, cherry-picked, and pushed to GitHub as PRs for review. You review the PRs on GitHub, and each agent rebases their local branch to reflect your decisions.

Human view (top row): On GitHub, you see the agent's PRs open for review. When you merge a PR, the changes become part of main. When you reject a PR, the changes are excised.

Agent view (bottom row): Locally, the agent accumulates commits on its own branch. A cron agent periodically reconciles the agent's branch with main — commits from PRs you reject are automatically excised from the agent's view.

Key features

• Every skill_manage call is committed immediately to an agent branch
• Changes are automatically grouped and submitted to GitHub as targeted PRs
• You review PRs on GitHub — merge what you like, reject what you don't
• Rejected changes are excised from the agent's branch automatically
• Supports multiple agents and multiple skill repositories
• Skill sync is also tracked, giving oversight of upstream changes to bundled skills

Installation

1. Install the setup skill from GitHub:

   hermes skills install cnuahs/skill-tracker/skills/skill-tracker-setup
   

2. Instruct the agent to set up the plugin:

   "set up skill-tracker"

   The agent will walk you through the full setup: installing the plugin, configuring tracked skill repos, etc.

3. Restart the gateway when prompted:

   hermes gateway restart
   

After restart, the plugin is loaded and cron jobs begin on schedule. The agent will verify the setup and confirm everything is working.

Configuring

The setup skill is designed to be safe to re-run. Use it to update or reconfigure skill-tracker after the initial installation:

• Add or remove tracked repos — "add a repo to skill-tracker"
• Change the token or agent name — "update skill-tracker config"
• Update the plugin — "update skill-tracker" (pulls latest from GitHub)
• Fix cron jobs — "recreate skill-tracker cron jobs"

Just tell the agent what you want to change. It will load the setup skill, check the current installation and configuration state, and update only what needs changing.