Skip to content

add provision-quality parquet path - #92

Merged
tombrooks248 merged 1 commit into
mainfrom
feat/provision-quality-parquet-path
Jul 20, 2026
Merged

add provision-quality parquet path#92
tombrooks248 merged 1 commit into
mainfrom
feat/provision-quality-parquet-path

Conversation

@tombrooks248

@tombrooks248 tombrooks248 commented Jul 16, 2026

Copy link
Copy Markdown
Contributor

What type of PR is this? (check all applicable)

  • Refactor
  • Feature
  • Bug Fix
  • Optimization
  • Documentation Update

Description

Pass --parquet-datasets-path to the provision-quality EMR task so the job can write its Delta tables. Mirrors the existing assemble-tasks arg.

Why

We are now into the implementation stage of provision-quality work so that it will write to Delta Lake + Postgres, not just CSVs. Delta needs the parquet-datasets path.

Related Tickets & Documents

QA Instructions, Screenshots, Recordings

I have deployed this to Staging - ran the new provision-quality task in Staging - all ran successfully with no errors.

Added/updated tests?

We encourage you to keep the code coverage percentage at 80% and above. Please refer to the Digital Land Testing Guidance for more information.

  • Yes
  • No, and this is why: just adding some args, no new features.
  • I need help with writing tests

[optional] Are there any post deployment tasks we need to perform?

[optional] Are there any dependencies on other PRs or Work?

@tombrooks248
tombrooks248 marked this pull request as ready for review July 20, 2026 14:05
@tombrooks248
tombrooks248 merged commit 49b2fc1 into main Jul 20, 2026
5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant