Skip to content

June 2026 data refresh: 50 new evaluations, 45+ status corrections - #7

Merged
JBAhire merged 1 commit into
mainfrom
update/2026-06-data-refresh
Jun 10, 2026
Merged

June 2026 data refresh: 50 new evaluations, 45+ status corrections#7
JBAhire merged 1 commit into
mainfrom
update/2026-06-data-refresh

Conversation

@JBAhire

@JBAhire JBAhire commented Jun 10, 2026

Copy link
Copy Markdown
Contributor

Summary

Full refresh of the TrustVector registry (last evaluated January 2026 → June 2026). Grows the catalog from 106 → 156 evaluations (60 models, 50 agents, 46 MCPs) and corrects every entry whose status changed.

New models (22)

  • Anthropic: Claude Fable 5, Opus 4.8 / 4.7 / 4.6, Sonnet 4.6
  • OpenAI: GPT-5.5 (current flagship), GPT-5.4, GPT-5.3-Codex
  • Google: Gemini 3.1 Pro, Gemini 3.5 Flash, Gemma 4
  • xAI / Amazon / Mistral / Cohere: Grok 4.3, Grok 4.1, Nova 2 Lite, Mistral Large 3, Command A+
  • Open-weight: DeepSeek V3.2 + V4, Qwen3.5, Kimi K2.6, GLM-5, MiniMax-M2

New agents (16)

Claude Code, Claude Agent SDK, OpenAI Agents SDK, OpenAI Codex, Google ADK, Gemini CLI, Jules, GitHub Copilot coding agent, Microsoft Agent Framework, Devin, Cursor, Manus, smolagents, AWS Strands, Mastra, Dify

New MCP servers (12)

Context7, Chrome DevTools MCP, Playwright MCP, Serena, Figma, Stripe, Vercel, Hugging Face, Firecrawl, shadcn, Apify, Zapier

Status corrections (~45 existing entries)

  • Retired/shut down: Grok 3 (2026-05-15), Gemini 2.0 Flash (2026-06-01), OpenAI Swarm, AgentGPT, BabyAGI
  • Deprecations with dates: OpenAI Assistants API (sunset 2026-08-26), o1/o3/o4-mini + GPT-5.1/5.2-Codex API shutdowns, DeepSeek legacy endpoints
  • Security: 8 archived MCP reference servers flagged (unpatched SQL injection in postgres/sqlite reference servers), Langflow CVE-2025-3248 / CVE-2025-34291, Context7 ContextCrush incident documented
  • Renames: MemGPT → Letta, Vertex AI Agent Builder → Gemini Enterprise Agent Platform, AutoGen/Semantic Kernel → maintenance mode, Llama 4 Behemoth marked never released
  • Stale "most capable / flagship" claims on Opus 4.5, GPT-5.2, Gemini 3 Pro made historical

All entries carry evidence URLs with real dates and last_evaluated: 2026-06-10. lib/data.ts and the README badge/coverage section updated to match.

Test plan

  • npm run validate — 156 valid, 0 invalid
  • npx tsc --noEmit — clean
  • npm run build — succeeds; static pages generated for all 60 model ids

…ions

Models (22 new): Claude Fable 5, Opus 4.8/4.7/4.6, Sonnet 4.6, GPT-5.5,
GPT-5.4, GPT-5.3-Codex, Gemini 3.1 Pro, Gemini 3.5 Flash, Grok 4.3/4.1,
Nova 2 Lite, DeepSeek V3.2/V4, Qwen3.5, Kimi K2.6, GLM-5, MiniMax-M2,
Mistral Large 3, Gemma 4, Command A+.

Agents (16 new): Claude Code, Claude Agent SDK, OpenAI Agents SDK, Codex,
Google ADK, Gemini CLI, Jules, GitHub Copilot coding agent, Microsoft
Agent Framework, Devin, Cursor, Manus, smolagents, Strands, Mastra, Dify.

MCPs (12 new): Context7, Chrome DevTools, Playwright, Serena, Figma,
Stripe, Vercel, Hugging Face, Firecrawl, shadcn, Apify, Zapier.

Status corrections: Grok 3 retired, Gemini 2.0 Flash shut down,
Assistants API sunset 2026-08-26, OpenAI o-series/GPT-5.x deprecation
dates, archived MCP reference servers flagged (incl. unpatched SQLi in
postgres/sqlite), Langflow CVEs, MemGPT->Letta, Agent Builder rebrand,
AutoGen/SK maintenance mode, Llama 4 Behemoth marked never released.
@JBAhire
JBAhire merged commit 786f207 into main Jun 10, 2026
5 checks passed
@JBAhire
JBAhire deleted the update/2026-06-data-refresh branch June 10, 2026 17:32
@netlify

netlify Bot commented Jun 10, 2026

Copy link
Copy Markdown

Deploy Preview for scintillating-liger-b66f71 ready!

Name Link
🔨 Latest commit 7b8000c
🔍 Latest deploy log https://app.netlify.com/projects/scintillating-liger-b66f71/deploys/6a299b7a274af200089aa487
😎 Deploy Preview https://deploy-preview-7--scintillating-liger-b66f71.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify project configuration.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant