Skip to content

cleanup: rimossi report duplicati, csv_quick_shape, inspect summary arricchito - #437

Merged
Gabrymi93 merged 4 commits into
mainfrom
refactor/cleanup-readme-csv-shape
Jul 30, 2026
Merged

cleanup: rimossi report duplicati, csv_quick_shape, inspect summary arricchito#437
Gabrymi93 merged 4 commits into
mainfrom
refactor/cleanup-readme-csv-shape

Conversation

@Gabrymi93

Copy link
Copy Markdown
Member

Sintesi

Pulizia finale dopo la Fase 1: rimossi artefatti duplicati, arricchito inspect summary.

Cosa cambia

  • Refactor / performance

Dettaglio

Cosa Prima Dopo
_reports/{dataset}/{year}_run_report.json Scritto, mai letto RIMOSSO
_reports/{dataset}/README.md Scritto, mai letto RIMOSSO (già in PR #436 attuale)
csv_quick_shape() in duckdb_shape.py Dead code (mai chiamato) RIMOSSO
report.py (381 righe) build_run_report, write_run_report, _collect_* RIMOSSO (dati tutti in _runs/)
inspect summary output Solo status + error count Righe, colonne, qualità, warnings
118 file *.py,cover Spazzatura coverage PULITI

Impatto su contratti pubblici

Nessuno. I contratti pubblici (parquet su GCS, run record in _runs/) non cambiano.

  • dataset-incubator/push_archive.py: legge da _runs/, non da _reports/
  • dataset-incubator/post_merge_runner.py: legge da _runs/

Verifica

# Nuovo inspect summary
toolkit inspect summary -c dataset.yml --year 2024

# Output:
# layer  righe    colonne  qualità  errori  warning
# raw    40521    23       100      0       0
# clean  40521    23       90       0       2
# mart   581      48       75       0       5
# warnings: 7 messaggi (transition + scaffold)
  • Test su candidato reale (dipendenti-pubblici)
  • ruff check . passa
  • pytest -m core passa

@Gabrymi93
Gabrymi93 merged commit d493d69 into main Jul 30, 2026
3 checks passed
@Gabrymi93
Gabrymi93 deleted the refactor/cleanup-readme-csv-shape branch July 30, 2026 13:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant