Skip to content

Workflow update from uat#16

Merged
douglowe merged 2 commits into
developmentfrom
workflow-update-from-uat
Feb 19, 2026
Merged

Workflow update from uat#16
douglowe merged 2 commits into
developmentfrom
workflow-update-from-uat

Conversation

@douglowe

Copy link
Copy Markdown
Member

Issue Description

User testing has highlighted some issues with the workflow. Main issues:

  • multicore queue isn't universally available
  • an OOM error occurs when using the python data extraction script for more than a couple of days of output

What does this PR do?

Changes in this PR:

  • Switch from multicore to multicore_small, and adapt cores and wallclock appropriately
  • Add date range loop to the bash logic for data extraction, avoiding the OOM error for the python script (as this is called per day)

@douglowe douglowe self-assigned this Feb 19, 2026
@douglowe douglowe merged commit a764c5a into development Feb 19, 2026
5 of 7 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant