Skip to content

E2E pipeline template: PUDL-to-GridPath config and docs#1361

Open
allisonmcampbell wants to merge 1 commit into
blue-marble:developfrom
allisonmcampbell:feature/e2e-pipeline-template
Open

E2E pipeline template: PUDL-to-GridPath config and docs#1361
allisonmcampbell wants to merge 1 commit into
blue-marble:developfrom
allisonmcampbell:feature/e2e-pipeline-template

Conversation

@allisonmcampbell
Copy link
Copy Markdown
Contributor

Summary

  • Adds a complete set of configuration files for running the PUDL-to-GridPath end-to-end pipeline (db/csvs_test_examples/raw_data_ra_toolkit_e2e/)
  • Includes ra_toolkit_e2e_settings_sample.csv with all data toolkit steps configured
  • Covers temporal scenarios (sync, monte carlo, full year), weather data, hydro parameters, and an eia_gridpath_key covering all WECC technology types
  • Adds user guide (docs/ra_toolkit_e2e_guide.md) and change documentation (docs/ra_toolkit_e2e_changes.md)

Context

This template enables users to run the full data toolkit pipeline from PUDL-extracted data through to a solvable GridPath scenario. The settings sample uses --aggregate_projects from #1360 to keep the optimization problem tractable on a local machine.

All files are new — no existing code is modified.

Test plan

  • All new files, no code changes — no test regressions possible
  • Template validated by running the full e2e pipeline locally with CBC solver

🤖 Generated with Claude Code

Adds a complete set of configuration files for running the PUDL-to-GridPath
end-to-end pipeline, including temporal scenarios (sync, monte carlo, full),
weather data, hydro parameters, and an eia_gridpath_key covering all WECC
technology types. Includes user guide and change documentation.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant