Skip to content

Validate partition mapper source keys before scheduling#67119

Draft
desusaiteja wants to merge 2 commits into
apache:mainfrom
desusaiteja:issue-58943-partition-mapper-roundtrip
Draft

Validate partition mapper source keys before scheduling#67119
desusaiteja wants to merge 2 commits into
apache:mainfrom
desusaiteja:issue-58943-partition-mapper-roundtrip

Conversation

@desusaiteja

@desusaiteja desusaiteja commented May 18, 2026

Copy link
Copy Markdown

Reject non-canonical source partition keys before a partition mapper records downstream mapping for partitioned asset-triggered Dags. This keeps malformed-but-parseable keys from being normalized into incorrect target partitions, and adds regression coverage for temporal, allowed-key, product, chain, and scheduler paths.

closes: #58943


Was generative AI tooling used to co-author this PR?
  • Yes — Codex (GPT-5)

Generated-by: Codex (GPT-5) following the guidelines


Important

🛠️ Maintainer triage note for @desusaiteja · by @potiuk · 2026-07-18 15:46 UTC

Helpful heads-up from the maintainers — please address before this PR can be reviewed:

  • Provider tests. See docs.

See the Pull Request quality criteria for details.

The ball is in your court — you've been assigned to this PR. Fix the above, then mark it Ready for review.

Automated triage — may be imperfect; a maintainer takes the next look.

@boring-cyborg boring-cyborg Bot added area:Scheduler including HA (high availability) scheduler area:task-sdk labels May 18, 2026
@potiuk potiuk added the ready for maintainer review Set after triaging when all criteria pass. label May 18, 2026
@desusaiteja
desusaiteja force-pushed the issue-58943-partition-mapper-roundtrip branch from e0afc2c to 32c8978 Compare May 30, 2026 23:09
@potiuk

potiuk commented Jun 25, 2026

Copy link
Copy Markdown
Member

@desusaiteja — I've removed the ready for maintainer review label because the next step here is yours: this branch now has merge conflicts with main. It'll go back into the maintainer queue automatically once you rebase onto the latest main and push — no need to re-add the label by hand. There's no rush.

Automated triage note drafted by an AI-assisted tool — may get things wrong; a real Apache Airflow maintainer takes the next look once it's green. (why automated)


Drafted-by: Claude Code (Opus 4.8); reviewed by @potiuk before posting

@potiuk potiuk removed the ready for maintainer review Set after triaging when all criteria pass. label Jun 25, 2026
@potiuk potiuk added the ready for maintainer review Set after triaging when all criteria pass. label Jul 2, 2026
@desusaiteja
desusaiteja force-pushed the issue-58943-partition-mapper-roundtrip branch from 32c8978 to e6d4911 Compare July 12, 2026 22:05
@potiuk
potiuk marked this pull request as draft July 18, 2026 15:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:Scheduler including HA (high availability) scheduler area:task-sdk ready for maintainer review Set after triaging when all criteria pass.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Validation on partition mappers for source partition formatting

2 participants