Skip to content

[codex] Rename runtime vocabulary to samples#119

Merged
cm2435 merged 5 commits into
devfrom
codex/episode-sample-pr00
Jun 7, 2026
Merged

[codex] Rename runtime vocabulary to samples#119
cm2435 merged 5 commits into
devfrom
codex/episode-sample-pr00

Conversation

@cm2435

@cm2435 cm2435 commented May 25, 2026

Copy link
Copy Markdown
Contributor

Review Guide

Stack position: PR 00, base dev, head codex/episode-sample-pr00.

Implements RFC Docs

  • 01-exec-summary.md: starts the runtime move from definition/run identity to sample identity.
  • 03b-implementation-churn.md: prereq PR 00, runtime vocabulary and state tests.
  • 03c-postgres-table-inventory.md: samples.id becomes the runtime root.
  • 09-implementation-plan/01-pr-00-runtime-vocabulary-and-state-tests.md.

Why This PR Exists

This is the broad mechanical rename that makes today's runtime sample-shaped before the typed WAL, heterogeneous experiment API, and candidate-pool semantics land. It does not try to delete the definition runtime bridge yet; it makes the naming and state-test baseline possible for the later PRs.

What Actually Changes

  • Renames core runtime/persistence concepts:
    • RunRecord -> SampleRecord, table runs -> samples.
    • RunTaskExecution -> SampleTaskAttempt, table run_task_executions -> sample_task_attempts.
    • RunTaskEvaluation -> SampleTaskEvaluation, table run_task_evaluations -> sample_task_evaluations.
    • RunResource -> SampleResource, table run_resources -> sample_resources.
    • RunStatus -> SampleStatus, RunResourceKind -> SampleResourceKind.
  • Moves runtime modules to sample vocabulary, including sample_records.py, sample_lifecycle.py, and sample_identity.py.
  • Replaces REST routes/runs.py with routes/samples.py and mounts samples_router.
  • Moves dashboard route/state from /run/[runId] to /samples/[sampleId], with component/library renames under components/sample and lib/sample-state.
  • Moves CLI surface from ergon run ... to ergon sample ... under ergon_cli/domains/samples.
  • Updates examples/observability to emit /samples/{sample_id} dashboard URLs and ergon sample status.

Gotchas / Review Risks

  • SampleRecord.definition_id intentionally remains. It is still the launch/source bridge until the definition-runtime deletion PR.
  • Compatibility aliases remain in sample_records.py: create_run, cancel_run, and latest_run_for_definition.
  • Generic graph mutation and annotation tables are only renamed here; PR 01 replaces them with typed sample WAL tables.
  • Some frontend/internal names remain run-shaped after this PR, such as loadRunSnapshot, RunSummary, RunsPage, and “Run Index”. Later PRs/remediation continue that cleanup.
  • RolloutBatchRun still exists here, although its FK becomes sample_id; rollout-batch sample membership is PR 02.

Cleaned Later

  • PR 01 replaces the generic mutation WAL with typed sample WAL.
  • PR 02 replaces rollout-batch run membership with sample membership.
  • PRs 03-05 add public Sample / Environment / Experiment authoring and materialization.
  • PR 11 deletes definition-backed runtime compatibility.

Validation Notes

Key guards include test_sample_runtime_vocabulary.py, test_sample_vocabulary_boundaries.py, sample route/read-model tests, sample CLI tests, and dashboard sample snapshot/delta contract tests.

@github-actions

Copy link
Copy Markdown

E2E smoke — minif2f

No PNG screenshots were uploaded for this leg. See screenshots/pr-119 for the uploaded placeholder.

@github-actions

Copy link
Copy Markdown

E2E smoke — swebench-verified

No PNG screenshots were uploaded for this leg. See screenshots/pr-119 for the uploaded placeholder.

@github-actions

Copy link
Copy Markdown

E2E smoke — researchrubrics

No PNG screenshots were uploaded for this leg. See screenshots/pr-119 for the uploaded placeholder.

@github-actions

Copy link
Copy Markdown

E2E smoke — swebench-verified

No PNG screenshots were uploaded for this leg. See screenshots/pr-119 for the uploaded placeholder.

@github-actions

Copy link
Copy Markdown

E2E smoke — researchrubrics

No PNG screenshots were uploaded for this leg. See screenshots/pr-119 for the uploaded placeholder.

@github-actions

Copy link
Copy Markdown

E2E smoke — minif2f

No PNG screenshots were uploaded for this leg. See screenshots/pr-119 for the uploaded placeholder.

@github-actions

Copy link
Copy Markdown

E2E smoke — minif2f

No PNG screenshots were uploaded for this leg. See screenshots/pr-119 for the uploaded placeholder.

@github-actions

Copy link
Copy Markdown

E2E smoke — swebench-verified

No PNG screenshots were uploaded for this leg. See screenshots/pr-119 for the uploaded placeholder.

@github-actions

Copy link
Copy Markdown

E2E smoke — researchrubrics

No PNG screenshots were uploaded for this leg. See screenshots/pr-119 for the uploaded placeholder.

@github-actions

Copy link
Copy Markdown

E2E smoke — minif2f

No PNG screenshots were uploaded for this leg. See screenshots/pr-119 for the uploaded placeholder.

@github-actions

Copy link
Copy Markdown

E2E smoke — researchrubrics

No PNG screenshots were uploaded for this leg. See screenshots/pr-119 for the uploaded placeholder.

@github-actions

Copy link
Copy Markdown

E2E smoke — swebench-verified

No PNG screenshots were uploaded for this leg. See screenshots/pr-119 for the uploaded placeholder.

@github-actions

Copy link
Copy Markdown

E2E smoke — swebench-verified

Screenshots pushed to screenshots/pr-119.

swebench-verified/cc1e0ea4-bf39-4184-8b07-0bb4252570d3-activity-stack.png
swebench-verified/cc1e0ea4-bf39-4184-8b07-0bb4252570d3-sad.png
swebench-verified/cc1e0ea4-bf39-4184-8b07-0bb4252570d3-visual-debugger-full.png
swebench-verified/ef5ed214-4002-4c62-9b1d-4ffb9a98ac74-activity-stack.png
swebench-verified/ef5ed214-4002-4c62-9b1d-4ffb9a98ac74-happy.png
swebench-verified/ef5ed214-4002-4c62-9b1d-4ffb9a98ac74-visual-debugger-full.png
swebench-verified/fc4b9501-ee70-4bdd-903c-8e616e8d364d-activity-stack.png
swebench-verified/fc4b9501-ee70-4bdd-903c-8e616e8d364d-happy.png
swebench-verified/fc4b9501-ee70-4bdd-903c-8e616e8d364d-visual-debugger-full.png

@github-actions

Copy link
Copy Markdown

E2E smoke — researchrubrics

Screenshots pushed to screenshots/pr-119.

researchrubrics/41c44fe1-d659-46ec-9c42-98a53077a55b-activity-stack.png
researchrubrics/41c44fe1-d659-46ec-9c42-98a53077a55b-happy.png
researchrubrics/41c44fe1-d659-46ec-9c42-98a53077a55b-visual-debugger-full.png
researchrubrics/a0fe8d7b-5661-4574-84c9-ebae44a82326-activity-stack.png
researchrubrics/a0fe8d7b-5661-4574-84c9-ebae44a82326-sad.png
researchrubrics/a0fe8d7b-5661-4574-84c9-ebae44a82326-visual-debugger-full.png
researchrubrics/a3799bb3-28db-40d6-a7dc-3cbd4d17f3df-activity-stack.png
researchrubrics/a3799bb3-28db-40d6-a7dc-3cbd4d17f3df-happy.png
researchrubrics/a3799bb3-28db-40d6-a7dc-3cbd4d17f3df-visual-debugger-full.png

@github-actions

Copy link
Copy Markdown

E2E smoke — minif2f

Screenshots pushed to screenshots/pr-119.

minif2f/17fe566b-7492-48b2-9fd6-24005f6c81bf-activity-stack.png
minif2f/17fe566b-7492-48b2-9fd6-24005f6c81bf-happy.png
minif2f/17fe566b-7492-48b2-9fd6-24005f6c81bf-visual-debugger-full.png
minif2f/2c40aea1-4851-48fb-b880-e67ce4f6cb15-activity-stack.png
minif2f/2c40aea1-4851-48fb-b880-e67ce4f6cb15-sad.png
minif2f/2c40aea1-4851-48fb-b880-e67ce4f6cb15-visual-debugger-full.png
minif2f/3ad600ff-e882-42ca-8d57-2871d2d42825-activity-stack.png
minif2f/3ad600ff-e882-42ca-8d57-2871d2d42825-happy.png
minif2f/3ad600ff-e882-42ca-8d57-2871d2d42825-visual-debugger-full.png

@cm2435
cm2435 marked this pull request as ready for review June 7, 2026 18:35
@cm2435
cm2435 merged commit 92142fd into dev Jun 7, 2026
8 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant