Skip to content

Run CI test groups on ubuntu only (drop the os matrix)#71

Merged
ChrisRackauckas merged 2 commits into
SciML:mainfrom
ChrisRackauckas-Claude:qa-ubuntu-only
Jun 10, 2026
Merged

Run CI test groups on ubuntu only (drop the os matrix)#71
ChrisRackauckas merged 2 commits into
SciML:mainfrom
ChrisRackauckas-Claude:qa-ubuntu-only

Conversation

@ChrisRackauckas-Claude

@ChrisRackauckas-Claude ChrisRackauckas-Claude commented Jun 10, 2026

Copy link
Copy Markdown
Contributor

The QA test group (Aqua/JET) was running on the full multi-OS matrix (ubuntu, macos, windows). Those checks are platform-independent, so the windows/macos QA jobs were wasted CI with no added coverage.

Extended per review feedback: the os axis is now dropped from all groups (Core included). This is a pure-Julia package — no platform-dependent code paths, no artifacts, no binary deps beyond stdlib — so per-OS CPU test runs add cost without coverage. With the os key absent, the grouped-tests workflow defaults each job to ubuntu-latest.

Two additional data points in favor:

  • The windows grouped jobs currently don't even run their declared group: the group-env step in SciML/.github tests.yml lacks shell: bash, so GROUP is never set on windows and every windows job silently runs the default group (fix: tests.yml: set test group env with shell: bash so it takes effect on Windows .github#81). Their green checkmarks were not real coverage.
  • GPU coverage is unaffected — it's a separate workflow on self-hosted runners.

Restoring an OS for any group later is one line in test/test_groups.toml.

Ignore until reviewed by @ChrisRackauckas.

🤖 Generated with Claude Code

ChrisRackauckas and others added 2 commits June 9, 2026 21:25
Aqua/JET QA checks are platform-independent, so running them on
windows-latest and macos-latest was wasted CI. Remove the os axis
from the [QA] group so it runs only on the default ubuntu-latest.
Core keeps its full multi-OS matrix.

Co-Authored-By: Chris Rackauckas <accounts@chrisrackauckas.com>
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
…pecific

Pure-Julia package with no platform-dependent code paths, artifacts, or
binary deps; macos/windows Core runs add CI cost without coverage. The
windows grouped jobs currently do not even run their declared group
(SciML/.github#81), so their green status was not real coverage anyway.

Co-Authored-By: Chris Rackauckas <accounts@chrisrackauckas.com>
@ChrisRackauckas-Claude ChrisRackauckas-Claude changed the title QA: run ubuntu-only (drop os matrix from the QA group) Run CI test groups on ubuntu only (drop the os matrix) Jun 10, 2026
@ChrisRackauckas ChrisRackauckas marked this pull request as ready for review June 10, 2026 10:02
@ChrisRackauckas ChrisRackauckas merged commit e37837e into SciML:main Jun 10, 2026
5 of 7 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants