Skip to content

docs(design): forward-looking improvement proposals#54

Closed
fazpu wants to merge 1 commit into
design/success-semantics-and-evaluationfrom
design/improvement-proposals
Closed

docs(design): forward-looking improvement proposals#54
fazpu wants to merge 1 commit into
design/success-semantics-and-evaluationfrom
design/improvement-proposals

Conversation

@fazpu

@fazpu fazpu commented Jul 12, 2026

Copy link
Copy Markdown
Member

What

Adds design/designs/improvement-proposals.md — the forward-looking companion to the success-semantics design doc (#53). Where #53 records decisions already made (and not to be reverted), this doc collects the changes we are considering, curated from the July 2026 review under design/analysis/ and re-prioritized. Every item is marked Proposed, not Accepted. No code changes.

Stacked on #53. Based on the design/success-semantics-and-evaluation branch so its cross-references resolve; GitHub will auto-retarget this to main once #53 merges. Review/merge #53 first.

Framing decision that drives priority

ugm will be driven by the planner/dispatcher double loop from the very beginning — not after a single-loop pilot. That moves the parent/child machinery from "harden later" to harden first, because it's exercised on day one of the flagship use case. The ordering reflects that.

Priorities

P0 — double-loop foundations

  • P0.1 Durable session-stack / active-child recovery — fixes the untested crash gap where a coordinator restart reopens the parent and orphans a running child.
  • P0.2 First-class paused / waiting_for_human state + typed gate/external-action requests (a governance pause is not an error).
  • P0.3 Per-child budgets (today a child inherits max_turns: 120).
  • P0.4 Make the PM template runnable from a clean init (it doesn't bundle its inner_outer_eval child set today).

P1 — legibility & safety

  • P1.1 events.jsonl + usage/cost ledger, then loopy status --watch.
  • P1.2 Deterministic backstop under the judge for high-stakes targets (e.g. ugm) — shells out to the repo's own contract tests; explicitly does not revert the eval decision in docs(design): record success-semantics and evaluation decisions #53.
  • P1.3 Fix the stale Agent Skill / "multi-worker" claims (pre-launch blocker).

P2 — hardening & DX

  • P2.1 Named model profiles + pin the trio (team-harness<0.3, eval-banana as an extra).
  • P2.2 _advance() refactor, folded into the P0.1 state-machine work.
  • P2.3 Richer failure taxonomy + per-workflow failure cap.
  • P2.4 doctor / validate / session-aware status + stop --force.

Explicitly deferred: parallel loopy workers, web dashboard, breadth-first child sessions.

Suggested sequencing

P0.1+P0.2+P2.2 (one coherent state-machine piece) → P0.3+P0.4 (double loop safe + runnable) → P1.1 (legible) → P1.2+P1.3 → P2.x rolling. After that, the double loop is ready to drive ugm — the subject of a separate execution design, not this doc.

🤖 Generated with Claude Code

https://claude.ai/code/session_01PN8aFwwxA8FzMy9LgpbQFt

Companion to success-semantics-and-evaluation.md. Where that doc records
decisions already made and not to be reverted, this one collects the
forward-looking changes we are considering, curated from the July 2026
review under design/analysis/ and re-prioritized.

Framing decision that drives priority: ugm will be driven by the
planner/dispatcher double loop from the very beginning (not after a
single-loop pilot), which moves the parent/child machinery from
"harden later" to "harden first".

Priorities:
- P0 (double-loop foundations): durable session-stack/active-child
  recovery (the untested crash gap), human-in-the-loop pause state,
  per-child budgets, and making the PM template runnable from a clean init.
- P1 (legibility/safety): events.jsonl + cost ledger, a deterministic
  backstop UNDER the judge for high-stakes targets (without reverting the
  eval decision), and fixing the stale Agent Skill.
- P2 (hardening/DX): model profiles + trio version pins, the _advance()
  refactor folded into the state-machine work, richer failure taxonomy,
  and operator UX (doctor/validate/session-aware status+stop).
- Explicitly deferred: parallel loopy workers, web dashboard, breadth-first
  child sessions.

All items are Proposed, not Accepted. No code changes.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01PN8aFwwxA8FzMy9LgpbQFt
@fazpu

fazpu commented Jul 12, 2026

Copy link
Copy Markdown
Member Author

Superseded by a clean, generic version based on main (see the new improvement-proposals PR). Closing this stacked branch.

@fazpu fazpu closed this Jul 12, 2026
@fazpu fazpu deleted the design/improvement-proposals branch July 12, 2026 20:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant