Skip to content

Pull requests: openai/simple-evals

New pull request New
19 Open 44 Closed
19 Open 44 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

feat: add batching support to GPQAEval via sampler.batch()
#111 opened May 24, 2026 by dcaayushd Loading…
1
Add ArxivRollBench eval
#110 opened May 24, 2026 by liangzid Loading…
fix: correct regex group extraction in browsecomp_eval.py
#93 opened Jul 4, 2025 by Neph0s Loading…
Anca/b
#92 opened Jun 23, 2025 by anca-loo Loading…
Anca br
#91 opened Jun 23, 2025 by anca-loo Loading…
Enhance simple-evals for beginner to run
#87 opened Jun 5, 2025 by ECNU3D Loading…
Jules version of beginner friendly README
#81 opened May 20, 2025 by rarhs Loading…
fix(queue): prevent duplicate message send (race condition)
#72 opened May 8, 2025 by Yuu6798 Loading…
feat: add len_var scorer (B-0)
#71 opened May 8, 2025 by Yuu6798 Loading…
fix: add semantic_match scorer to detect drift in math_eval
#69 opened May 4, 2025 by Yuu6798 • Draft
fix regex bug in browsecomp
#67 opened Apr 22, 2025 by tengyaolong2000 Loading…
1
fix: import collision for types
#66 opened Apr 21, 2025 by Ithanil Loading…
Small typo in grader
#57 opened Mar 25, 2025 by chiruu12 Loading…
add aime task
#55 opened Mar 12, 2025 by jason9693 Loading…
Initial commit
#45 opened Feb 1, 2025 by osmanjamalfarag Loading…
correct string spelling error
#37 opened Dec 27, 2024 by owos Loading…
Update SimpleQAEval to use direct CSV URL instead of blobfile
#26 opened Oct 31, 2024 by ZhangYiqun018 Loading…
Use correct _pack_message function name
#12 opened May 20, 2024 by andrewmbenton Loading…
1
Added Chartqa Dataset
#6 opened Apr 14, 2024 by tarunamasa Loading…
1
ProTip! Filter pull requests by the default branch with base:main.