Skip to content

[TEST] workflows/eval: evaluate ci/pinned.json changes at their commit#480436

Closed
MattSturgeon wants to merge 4 commits into
NixOS:masterfrom
MattSturgeon:test-ci-eval-workflow
Closed

[TEST] workflows/eval: evaluate ci/pinned.json changes at their commit#480436
MattSturgeon wants to merge 4 commits into
NixOS:masterfrom
MattSturgeon:test-ci-eval-workflow

Conversation

@MattSturgeon

@MattSturgeon MattSturgeon commented Jan 15, 2026

Copy link
Copy Markdown
Contributor

This PR tests #480395 in production

EDIT: later used to test #482470 too.

Outdated notes

Test 1 (43b2198) should "fail":

  • Bumps nixpkgs to a 2025-12-18 revision.
  • Reverts the earlier bump.
  • Reapplies it

This failed as expected:

Error: Error: Multiple commits touch ci/pinned.json in this PR:
d40b6518bace95ce0abe78304c3d9ebebbb9fb3e
cac5910069516f8122a2836fec8221a3e005ada5
43b219898e706d5dbae968621e88078e4c62d1a8
18065c8c13cd173a7911f1b67ec346ffc7f72182
Please ensure only a single commit modifies ci/pinned.json for accurate version matrix evaluation.

Test 2 (cd0b73f) should be "ok":

  • Bumps nixpkgs to a 2025-12-18 revision.
Attempt 1

This failed unexpectedly, finding an additional commit that is not part of this PR:

Error: Error: Multiple commits touch ci/pinned.json in this PR:
d40b6518bace95ce0abe78304c3d9ebebbb9fb3e
05d622cced19c0f67c73b4afe85014b1e06f3c50
Please ensure only a single commit modifies ci/pinned.json for accurate version matrix evaluation.

It lists d40b651 from this PR and 05d622c the merge commit. See https://github.com/NixOS/nixpkgs/pull/480395/changes#r2695743434.

Attempt 2 (with the PR updated to use HEAD SHA) seems to work:
https://github.com/NixOS/nixpkgs/actions/runs/21045169842/job/60517468599?pr=480436#step:4:61

Found pinned.json commit: cd0b73f24f46b64ed0d25f340f43a8b0f07f3779

However the report job unexpectedly finds changed outPaths:
https://github.com/NixOS/nixpkgs/actions/runs/21045169842/job/60525175036?pr=480436#step:3:82

Error: lixPackageSets.git.lix on aarch64-linux has changed outpaths!
Note: This indicates that commit cd0b73f24f46b64ed0d25f340f43a8b0f07f3779 (which modified ci/pinned.json) also contains other changes that affect package outputs. Please ensure ci/pinned.json is updated in a standalone commit.

Despite eval's comparison reporting zero changes.

Test 3 (827ad37) should be "ok":

  • Bumps nixpkgs to a 2025-12-18 revision.
  • Modifies an unrelated package in a separate commit

Attempt 1: fails unexpectedly:

@nixpkgs-ci nixpkgs-ci Bot added 10.rebuild-darwin: 0 This PR does not cause any packages to rebuild on Darwin. 10.rebuild-linux: 0 This PR does not cause any packages to rebuild on Linux. 6.topic: continuous integration Affects continuous integration (CI) in Nixpkgs, including Ofborg and GitHub Actions 6.topic: policy discussion Discuss policies to work in and around Nixpkgs backport release-25.11 labels Jan 15, 2026
@MattSturgeon MattSturgeon force-pushed the test-ci-eval-workflow branch 3 times, most recently from d40b651 to cd0b73f Compare January 15, 2026 20:21
@nixpkgs-ci nixpkgs-ci Bot added 10.rebuild-linux: 11-100 This PR causes between 11 and 100 packages to rebuild on Linux. 10.rebuild-darwin: 11-100 This PR causes between 11 and 100 packages to rebuild on Darwin. and removed 10.rebuild-darwin: 0 This PR does not cause any packages to rebuild on Darwin. 10.rebuild-linux: 0 This PR does not cause any packages to rebuild on Linux. labels Jan 15, 2026
@MattSturgeon MattSturgeon force-pushed the test-ci-eval-workflow branch 10 times, most recently from a5cc154 to 86f3f37 Compare January 21, 2026 23:24
In a shallow clone, `git fetch` may fail to apply thin packs due to
missing base objects.

We typically don't notice this with first-parent commits and prospective
merge commits, but it seems fairly common with arbitrary PR-branch
commits.

In this instance we don't need the full commit data, we only need to
apply its diff as a patch. So fetch the diff from GitHub's API and apply
using `git apply`.

This partially reverts commit 4787f35
@MattSturgeon MattSturgeon force-pushed the test-ci-eval-workflow branch from 86f3f37 to 6adef4f Compare January 21, 2026 23:46
@nixpkgs-ci nixpkgs-ci Bot added the 2.status: merge conflict This PR has merge conflicts with the target branch label Jan 25, 2026
@MattSturgeon MattSturgeon deleted the test-ci-eval-workflow branch March 3, 2026 20:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

2.status: merge conflict This PR has merge conflicts with the target branch 6.topic: continuous integration Affects continuous integration (CI) in Nixpkgs, including Ofborg and GitHub Actions 6.topic: policy discussion Discuss policies to work in and around Nixpkgs 10.rebuild-darwin: 11-100 This PR causes between 11 and 100 packages to rebuild on Darwin. 10.rebuild-linux: 11-100 This PR causes between 11 and 100 packages to rebuild on Linux.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant