Skip to content

monitor: focus filter spec + validation harnesses - #311

Open
anish749 wants to merge 6 commits into
mainfrom
worktree-semantic-filter-validate
Open

monitor: focus filter spec + validation harnesses#311
anish749 wants to merge 6 commits into
mainfrom
worktree-semantic-filter-validate

Conversation

@anish749

Copy link
Copy Markdown
Owner

Problem

The earlier monitor-semantic-filter-spec.md proposed a multi-vector intent filter (focus + positives + negatives + window fallback + geometry-derived threshold). Validation across three workspaces showed that simpler is strictly better under the metrics that matter for fan-in reduction (the agent on the receiving end self-filters; precision at the router buys nothing).

Solution

  • New spec at docs/monitor-focus-filter-spec.md: pure focus-cosine threshold per filter, multi-route across instances. Six-line algorithm. Threshold default 0.22 with --mode recall preset at 0.18. Section 2 of the spec records the full validation methodology, all metrics, and per-component rejection rationale.
  • Validation harnesses under experiments/: ground-truth labelling via Claude judge, threshold sweeps reporting recall / wake-rate-on-noise / sessions-woken-per-msg, focus-prose pairwise geometry analysis, embedder comparison (MiniLM vs bge vs e5).
  • workstreams.example.json documents the config schema; the actual workstreams.json and labels-*.json are gitignored (workspace-specific data).

Context

Supersedes the previous spec but does not delete it; the new spec links to it explicitly. Reviewer should read Section 1 first; Section 2 is the methodology trail in case anything looks underjustified.

@anish749
anish749 force-pushed the worktree-semantic-filter-validate branch from d289d29 to ac7bd05 Compare April 26, 2026 05:58
@anish749
anish749 force-pushed the worktree-semantic-filter-validate branch from ac7bd05 to ce1efce Compare May 28, 2026 21:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant