Add local mock user agent judge loop - #18

Open

lishehao wants to merge 18 commits into

mainfrom

codex/mock-user-agent-judge-loop

Commits on Jun 2, 2026

feat: add narrative agent trace judge loop
lishehao
committed
e20bb76
feat: complete narrative agent eval chain
lishehao
committed
7beffe1
test: clarify mock narrative turn responder
lishehao
committed
7d59cbb
test: clarify narrative trace turn responder
lishehao
committed
15b48ff
docs: align mock user eval with live DeepSeek gateway
lishehao
committed
e13b7db
feat: add narrative gold set llm judge loop
lishehao
committed
7722ba4
fix: preserve llm judge failure reports
lishehao
committed
0a850cc
fix: strip llm judge metadata before validation
lishehao
committed
956885c
fix: harden live llm judge evaluation gates
lishehao
committed
d70f004
fix: normalize llm judge expectation misses
lishehao
committed
973d0cd
fix: report live runtime eval failures
lishehao
committed
2a58b81
fix: gate required llm judge expectations
lishehao
committed
0b8504f
fix: normalize llm judge confidence labels
lishehao
committed
dd6f5f7
fix: surface leverage payoff evidence for judge
lishehao
committed
b38fdd4
fix: flag rubric-weight judge scores
lishehao
committed
67e156f
fix: harden playtest ux followups
lishehao
committed
e2c7344
fix: polish reviewer trace affordance
lishehao
committed
13e38f7
fix: harden public repo evidence for agent eval PR
lishehao
committed
9c39251