Skip to content

feat(0.41.0): GenerationRecord per-candidate dimensional + per-scenario scores#102

Merged
drewstone merged 1 commit into
mainfrom
feat/generation-candidate-evidence
May 25, 2026
Merged

feat(0.41.0): GenerationRecord per-candidate dimensional + per-scenario scores#102
drewstone merged 1 commit into
mainfrom
feat/generation-candidate-evidence

Conversation

@drewstone
Copy link
Copy Markdown
Contributor

Summary

  • Extend `GenerationRecord.candidates` with `dimensions` (mean per judge dimension) + `scenarios` (per-scenario composite), exported as `GenerationCandidate`.
  • A reflective `ImprovementDriver` (LLM proposing improved surfaces conditioned on the parent's weakest dimensions + best/worst scenarios) needs more than one composite per candidate; `ProposeContext.history` only carried `{surfaceHash, composite, ci95}`.
  • Populated in `run-optimization` from each candidate's campaign cells.

Why

Unblocks the faithful reflection-mutator port onto the substrate (creative-agent `system-prompt-head` surface) — replacing run-prompt-evolution's bespoke GA — without a per-consumer side channel.

Test plan

  • New regression test in presets.test.ts asserts candidates carry populated `dimensions` + per-scenario `scenarios`
  • Full suite green (1424 tests)
  • typecheck + build clean

Version-lock bump 0.40.5 → 0.41.0 (npm + pyproject + python client).

…r-scenario scores

A reflective ImprovementDriver (e.g. an LLM that proposes improved prompts
conditioned on the parent's weakest dimensions + best/worst scenarios) needs
more than one composite per candidate. Extend GenerationRecord.candidates
with:
  - dimensions: Record<string, number>  (mean per judge dimension)
  - scenarios:  Array<{scenarioId, composite}>  (per-scenario composite)

Populated in run-optimization from each candidate's campaign cells; exported
as GenerationCandidate. Unblocks faithful reflection-mutator ports onto the
substrate (creative-agent system-prompt-head surface) without per-consumer
side channels.

Version-lock bump: npm + pyproject + python client __version__.
@drewstone drewstone merged commit 5afa048 into main May 25, 2026
1 check passed
@drewstone drewstone deleted the feat/generation-candidate-evidence branch May 25, 2026 22:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant