Skip to content

(TESTING, NOT FOR MERGE) Skip decoding statistics - #8630

Closed
alamb wants to merge 1 commit into
apache:mainfrom
alamb:alamb/hack_out_stats
Closed

(TESTING, NOT FOR MERGE) Skip decoding statistics#8630
alamb wants to merge 1 commit into
apache:mainfrom
alamb:alamb/hack_out_stats

Conversation

@alamb

@alamb alamb commented Oct 15, 2025

Copy link
Copy Markdown
Contributor

Successor to alamb#54

Rationale

This PR is part of testing how much faster Parquet thrift decoding would be if/when we extended the APIs to skip parsing the portions that are not needed for query, specifically various statistics from the parquet footer metadata (aka column stats and encoding stats)

I do not intend to propose merging this (ever)

Changes:

Comment out decoding of statistics in metadata, to mimic the effect of actually implementing

@github-actions github-actions Bot added the parquet Changes to the parquet crate label Oct 15, 2025
@alamb alamb changed the title Skip decoding statistics (TESTING, NOT FOR MERGE) Skip decoding statistics Oct 15, 2025
@alamb
alamb force-pushed the alamb/hack_out_stats branch from dc023f5 to 2807919 Compare October 23, 2025 11:15
@alamb alamb closed this Nov 13, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

parquet Changes to the parquet crate

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant