From 3fd8346346ef4efa03a07ee2855778d856fc65a6 Mon Sep 17 00:00:00 2001 From: Jack Chen Date: Mon, 10 Aug 2026 23:16:36 +0800 Subject: [PATCH] Add Open Multi-Agent evaluation --- README.md | 1 + 1 file changed, 1 insertion(+) diff --git a/README.md b/README.md index 4ea2ad2..82f1b39 100644 --- a/README.md +++ b/README.md @@ -169,6 +169,7 @@ Most "awesome" lists are link dumps. This one is **annotated and verified**: eve ### 5b Β· TypeScript/JS-native eval runners - **[evalite](https://github.com/mattpocock/evalite)** β€” Matt Pocock β€” β€” πŸ†• local-first eval runner on Vitest; `.eval.ts` files, web UI, cost-aware. - **[Mastra scorers](https://github.com/mastra-ai/mastra)** β€” (`mastra.ai/docs/evals/overview`) β€” πŸ†• model-graded/rule/statistical scorers, live evals, CI, in the Mastra agent framework. +- **[Open Multi-Agent evaluation](https://github.com/open-multi-agent/open-multi-agent)** β€” Open Multi-Agent β€” Β· *tool/framework* β€” πŸ†• TypeScript-native, versioned EvalSets with offline JSON/Markdown/JUnit reports, baseline regression gates for CI, and opt-in production sampling that scores settled runs asynchronously without changing their results. - **[Vercel agent-eval](https://github.com/vercel-labs/agent-eval)** β€” β€” πŸ†• A/B-test coding agents (Claude Code, Codex, Cursor) on custom tasks; pass-rate dashboards. - **[Autoevals](https://github.com/braintrustdata/autoevals)** β€” Braintrust β€” β€” OSS scorer library (Factuality, relevance, security…) across Py/JS/Go/Ruby.