docs(parallel-evals): parallel evaluation runbook + known issues#126
Merged
Conversation
pradeepvrd
force-pushed
the
feat/parallel-eval-runs
branch
2 times, most recently
from
e39b5ba to
60f6241
Compare
pradeepvrd
force-pushed
the
refactor/comparison
branch
from
1e1ed88 to
3243099
Compare
pradeepvrd
force-pushed
the
feat/parallel-eval-runs
branch
from
60f6241 to
d03e8bb
Compare
pradeepvrd
force-pushed
the
refactor/comparison
branch
from
3243099 to
1e800e1
Compare
pradeepvrd
force-pushed
the
feat/parallel-eval-runs
branch
from
d03e8bb to
ad798f2
Compare
pradeepvrd
changed the title
pradeepvrd
changed the base branch from
refactor/comparison
to
feat/bastion-matrix
pradeepvrd
force-pushed
the
feat/parallel-eval-runs
branch
from
ad798f2 to
09bb5e1
Compare
pradeepvrd
force-pushed
the
feat/bastion-matrix
branch
from
7397fd3 to
67ccec5
Compare
pradeepvrd
force-pushed
the
feat/bastion-matrix
branch
from
e64394a to
7ac941f
Compare
pradeepvrd
force-pushed
the
feat/parallel-eval-runs
branch
2 times, most recently
from
3d429b0 to
171284a
Compare
pradeepvrd
force-pushed
the
feat/bastion-matrix
branch
from
a1b6078 to
b313cdf
Compare
pradeepvrd
force-pushed
the
feat/parallel-eval-runs
branch
from
171284a to
db13131
Compare
pradeepvrd
changed the title
pradeepvrd
force-pushed
the
feat/bastion-matrix
branch
from
b313cdf to
e9c740d
Compare
pradeepvrd
force-pushed
the
feat/parallel-eval-runs
branch
from
db13131 to
9192949
Compare
Add docs/parallel-evals.md: the end-to-end parallel-evaluation runbook (matrix CUJs, parallel-safety rules, resume-after-drop, Vertex setup), known issues from review findings, and the local-default / BENCH_REMOTE execution note. Docs-only; the run-parallel-evals skill lives in the skills PR (#132).
pradeepvrd
force-pushed
the
feat/bastion-matrix
branch
from
e9c740d to
460cc45
Compare
pradeepvrd
force-pushed
the
feat/parallel-eval-runs
branch
from
9192949 to
8e074c9
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Adds
docs/parallel-evals.md— the end-to-end parallel-evaluation runbook: matrix CUJs, theparallel-safety rules (legacy + gemini CLI are not parallel-safe), resume-after-drop, Vertex setup,
and the local-default /
BENCH_REMOTEexecution note, plus known issues gathered from reviewfindings.
Docs-only. The
run-parallel-evalsskill that drives this workflow lives in the skills PR (#132).