Skip to content

[CI] Add weekly conformance run against latest upstream release#304

Merged
chr-hertel merged 1 commit into
modelcontextprotocol:mainfrom
soyuka:ci-weekly-conformance
May 17, 2026
Merged

[CI] Add weekly conformance run against latest upstream release#304
chr-hertel merged 1 commit into
modelcontextprotocol:mainfrom
soyuka:ci-weekly-conformance

Conversation

@soyuka
Copy link
Copy Markdown
Contributor

@soyuka soyuka commented May 12, 2026

The PR pipeline only runs conformance when someone opens a PR. Upstream @modelcontextprotocol/conformance releases between PRs go untested.

This workflow:

  • runs the same conformance commands on a weekly cron (Mondays 06:00 UTC),
  • can be triggered manually from the Actions tab (workflow_dispatch),
  • pins to @modelcontextprotocol/conformance@latest to pick up new releases,
  • opens (or comments on) a tracking issue labelled conformance-weekly on scheduled failures.

Test plan

  • Manual run from the Actions tab succeeds (or fails cleanly with an issue filed)

Comment thread .github/workflows/conformance-weekly.yaml Outdated
Comment thread .github/workflows/conformance-weekly.yaml
@soyuka
Copy link
Copy Markdown
Contributor Author

soyuka commented May 15, 2026

global opinion about this? should I clean it up?

@chr-hertel
Copy link
Copy Markdown
Member

+1 from my end, yes :)
was wondering about creating an issue, but it's the best fit for our tools

@soyuka soyuka force-pushed the ci-weekly-conformance branch from 4b93d6e to b5eb914 Compare May 17, 2026 08:01
The PR pipeline only catches conformance changes when someone opens a
PR. Upstream `@modelcontextprotocol/conformance` releases between PRs
go untested. This adds a weekly cron + `workflow_dispatch` trigger
pinned to `@latest`, and opens a tracking issue on scheduled failures.
@soyuka soyuka force-pushed the ci-weekly-conformance branch from b5eb914 to 17d0b70 Compare May 17, 2026 08:13
@chr-hertel chr-hertel merged commit 1d71000 into modelcontextprotocol:main May 17, 2026
18 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants