Skip to content

Experiment Runner smoke test#839

Open
ajonkisz wants to merge 4 commits into
masterfrom
goal/experiment-smo-cdb260f0
Open

Experiment Runner smoke test#839
ajonkisz wants to merge 4 commits into
masterfrom
goal/experiment-smo-cdb260f0

Conversation

@ajonkisz

Copy link
Copy Markdown
Collaborator

Summary

  • Documented the live Experiment Runner smoke test evidence, including pack activation, launch surfaces, A/B fan-out, treatment metadata propagation, route lifecycle, report generation, and autoresearch guardrails.
  • Added non-optional browser E2E smoke coverage using a deterministic local fixture pack so launcher/deep-link/panel coverage runs even when the real pack is absent from the isolated test gateway.
  • Verified the runner is ready for a small real Graphify A/B benchmark with caveats around realistic per-run budget and workflow choice.

Validation

  • Implementation gate passed: build, typecheck, unit tests, E2E tests, gap/code/security/E2E reviews.
  • Documentation gate passed.
  • Manual live smoke evidence captured in docs/experiment-runner-smoke-test.md.

🤖 Generated with Bobbit

ajonkisz and others added 4 commits June 21, 2026 00:43
Co-authored-by: bobbit-ai <bobbit@bobbit.ai>
Co-authored-by: bobbit-ai <bobbit@bobbit.ai>
Co-authored-by: bobbit-ai <bobbit@bobbit.ai>
Co-authored-by: bobbit-ai <bobbit@bobbit.ai>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant