Skip to content

docs: add Liander 2024 benchmark results page under Guides#945

Merged
egordm merged 4 commits into
mainfrom
docs/benchmark-results
Jun 5, 2026
Merged

docs: add Liander 2024 benchmark results page under Guides#945
egordm merged 4 commits into
mainfrom
docs/benchmark-results

Conversation

@egordm
Copy link
Copy Markdown
Collaborator

@egordm egordm commented Jun 4, 2026

Summary

Adds a Benchmark Results guide that documents how each OpenSTEF model performs on the public Liander 2024 benchmark, so users have a concrete, data-driven reference for model selection.

What's included

  • At-a-glance grouped box-plot of rCRPS by target group (docs/source/images/guides/liander2024_rcrps_by_group.png).
  • The Metrics section explaining rCRPS and the sample-weighted variant (with KaTeX formulas).
  • Two results tables (mean rCRPS across targets) — unweighted and sample-weighted — with rows per model (XGBoost, GBLinear, Ensemble) and columns per target group (Global, MV feeder, Station inst., Transformer, Solar park, Wind park).
  • How these numbers were produced methodology note. The ensemble is an openstef-meta learned-weight combination of LightGBM and GBLinear base models.

Wiring

  • Linked from the Guides index as a new card + toctree entry.
  • Cross-linked from the Model Selection concept page via a seealso.

Notes

  • REUSE-compliant: new PNG has a .license sidecar; the .rst carries an SPDX header.
  • Docs build passes locally (sphinx-build EXIT=0; only pre-existing autodoc warnings remain).

Add a Benchmark Results guide showing rCRPS performance of each model on the public Liander 2024 benchmark, including a grouped box-plot, two results tables (unweighted and sample-weighted rCRPS by target group), and explanations of the metrics. Link it from the Guides index and from the Model Selection concept page.

Signed-off-by: Egor Dmitriev <egor.dmitriev@alliander.com>
@egordm egordm requested a review from a team June 4, 2026 13:20
@github-actions github-actions Bot added the chore Improvements or additions to documentation label Jun 4, 2026
egordm added 3 commits June 4, 2026 15:39
Add rMAE (relative Mean Absolute Error of the median forecast) metric explanation and table to the Benchmark Results guide, extracted from the Liander 2024 summary.html.

Signed-off-by: Egor Dmitriev <egor.dmitriev@alliander.com>
Signed-off-by: Egor Dmitriev <egor.dmitriev@alliander.com>
Signed-off-by: Egor Dmitriev <egor.dmitriev@alliander.com>
@sonarqubecloud
Copy link
Copy Markdown

sonarqubecloud Bot commented Jun 4, 2026

@egordm egordm merged commit 5ba59f1 into main Jun 5, 2026
5 checks passed
@egordm egordm deleted the docs/benchmark-results branch June 5, 2026 07:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

chore Improvements or additions to documentation

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants