Scoring Module Dev: atomic stage-pipeline protocols with official-result validation - #149

Merged

Irisicy4 merged 15 commits into

mainfrom

Aug 3, 2026

Commits on Apr 22, 2026

fix tsv multi image placeholder bug
yijiang.li
committed
1410d03
update inference launch options and media placeholder checks
yijiang.li
committed
53409bf

Commits on Apr 28, 2026

Merge branch 'main' of github.com:mm-evaluation/simple-mmeval
yijiang.li
committed
ae9ebd9
add scoring
yijiang.li
committed
be4bd68
add series arg for better testing local models
yijiang.li
committed
e349038

Commits on Jun 13, 2026

revise grading and try to match results with official
yijiang.li
committed
2c255f8

Commits on Jun 27, 2026

eval: render MCQ options for HRBench/MMVP; Qwen3-VL bf16+flash default

yliang.26
and
claude
committed
b0b89a8

Commits on Jul 8, 2026

scoring: overhaul to metadata-driven eval pipeline
ZTWHHH
committed
9733f40
remove unnecessary files
ZTWHHH
committed
f0d35f9
remove unnecessary files
ZTWHHH
committed
1a36b0c

Commits on Jul 10, 2026

sync: merge origin/main into dev-eval-opsd

ZTWHHH
and
claude
committed
cd1fb16
scoring: address PR #149 review feedback

ZTWHHH
and
claude
committed
0d2abcf
scoring: address second-round review (fixture coverage, compact-gt guard)

ZTWHHH
and
claude
committed
cbe951a

Commits on Jul 21, 2026

scoring: atomic-stage pipeline overhaul, official-protocol validation, docs

ZTWHHH
and
cursoragent
committed
3aa72c0

Commits on Jul 26, 2026

scoring: open-weight local judge, dataset identity in resume cache, examples

ZTWHHH
and
cursoragent
committed
eacdc72