Skip to content

Update official conformance to alpha.2#277

Draft
leehack wants to merge 1 commit into
dev/2026-07-28-rcfrom
update-conformance-alpha2
Draft

Update official conformance to alpha.2#277
leehack wants to merge 1 commit into
dev/2026-07-28-rcfrom
update-conformance-alpha2

Conversation

@leehack

@leehack leehack commented Jun 4, 2026

Copy link
Copy Markdown
Owner

Summary

  • Bump official MCP conformance runners and CI client gate from @modelcontextprotocol/conformance@0.2.0-alpha.1 to 0.2.0-alpha.2.
  • Force the 2026 RC server runner to execute the draft suite with --spec-version DRAFT-2026-v1.
  • Update the 2026 RC client fixture so draft scenarios use the conformance-provided protocol version instead of falling back to stable protocol behavior.
  • Track json-schema-ref-no-deref as an expected 2026 RC client failure because the alpha.2 fixture advertises only stable protocol versions when the runner forces DRAFT-2026-v1.

Validation

  • dart format .
  • dart analyze
  • dart test (rerun passed; first run had one non-reproducing SSE assertion failure while other gates were running in parallel)
  • dart run bin/mcp_dart.dart conformance --suite all --json from packages/mcp_dart_cli (72/72)
  • dart run test/conformance/run_2025_server_conformance.dart --output-dir .dart_tool/conformance/alpha2_fix_2025_server --timeout-seconds 90 (49/49)
  • npx -y @modelcontextprotocol/conformance@0.2.0-alpha.2 client --command "dart run test/conformance/mcp_2026_rc_client.dart" --suite all --spec-version 2025-11-25 --verbose -o .dart_tool/conformance/alpha2_fix_2025_client (222/222)
  • dart run test/conformance/run_2026_rc_server_conformance.dart --output-dir .dart_tool/conformance/alpha2_fix_2026_server --timeout-seconds 90 (19/19)
  • dart run test/conformance/run_2026_rc_client_conformance.dart --output-dir .dart_tool/conformance/alpha2_fix_2026_client_full --timeout-seconds 90 (34 passed, 1 expected failure)

@leehack leehack force-pushed the update-conformance-alpha2 branch 2 times, most recently from 76150de to 43c277b Compare June 4, 2026 12:02
@leehack leehack force-pushed the update-conformance-alpha2 branch from 43c277b to dbf89e9 Compare June 4, 2026 12:24
@codecov

codecov Bot commented Jun 4, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 84.75%. Comparing base (a07d0a3) to head (dbf89e9).
⚠️ Report is 1 commits behind head on dev/2026-07-28-rc.

Additional details and impacted files
@@                Coverage Diff                 @@
##           dev/2026-07-28-rc     #277   +/-   ##
==================================================
  Coverage              84.75%   84.75%           
==================================================
  Files                     70       70           
  Lines                  15364    15364           
==================================================
  Hits                   13022    13022           
  Misses                  2342     2342           
Flag Coverage Δ
cli 76.73% <ø> (ø)
unittests 88.24% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant