Skip to content

Add more validation results#460

Open
ppinchuk wants to merge 10 commits into
mainfrom
pp/geo_web_val
Open

Add more validation results#460
ppinchuk wants to merge 10 commits into
mainfrom
pp/geo_web_val

Conversation

@ppinchuk
Copy link
Copy Markdown
Collaborator

Add validation results from geothermal electricity web scraping as well as the old solar and wind validation pieces that were missing

@ppinchuk ppinchuk added this to the Quality assurance milestone May 30, 2026
@ppinchuk ppinchuk self-assigned this May 30, 2026
Copilot AI review requested due to automatic review settings May 30, 2026 01:14
@ppinchuk ppinchuk requested a review from castelao as a code owner May 30, 2026 01:14
@ppinchuk ppinchuk added documentation Improvements or additions to documentation enhancement Update to logic or general code improvements p-low Priority: low labels May 30, 2026
@ppinchuk ppinchuk requested a review from rajeee May 30, 2026 01:15
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR adds new validation reporting artifacts, including a geothermal web scraping validation notebook and shared utility functions for computing/plotting confusion matrices, along with updated validation documentation and README/About links.

Changes:

  • New shared validation utility module (val_utils.py) factoring out compute_stats, plot_compass_confusion_matrix_from_data, and plot_compass_confusion_matrix for reuse across validation notebooks.
  • New May_2026_Geothermal_webscraping_validation.ipynb notebook reporting COMPASS vs human document collection results (90% accuracy, 85.71% precision, 90% recall on 100 reviewed rows).
  • Validation report expansion in docs/source/val/validation.rst (new Geothermal May 2026, Wind September, Solar August 2025 sections) plus README/About updates linking to the validation report and swapping Solar/Wind dataset submission IDs.

Reviewed changes

Copilot reviewed 4 out of 9 changed files in this pull request and generated 1 comment.

Show a summary per file
File Description
support/validation/val_utils.py New shared helpers for confusion matrix stats and plotting used by validation notebooks.
support/validation/May_2026_Geothermal_webscraping_validation.ipynb New geothermal webscraping validation notebook with COMPASS/human scoring logic and plots.
docs/source/val/validation.rst Adds geothermal, wind (Sept), and solar (Aug 2025) validation sections with images.
README.rst Updates branding to COMPASS, adds validation report link, swaps Solar/Wind OpenEI dataset IDs.
docs/source/misc/about.rst Adds a Validation section linking to the validation report.

Comment thread README.rst Outdated
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

documentation Improvements or additions to documentation enhancement Update to logic or general code improvements p-low Priority: low

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants