Skip to content

[POC] disable readAhead for parquet#126

Open
anmolanmol1234 wants to merge 1 commit into
wasbDepCodeReviewfrom
readAheadDisable
Open

[POC] disable readAhead for parquet#126
anmolanmol1234 wants to merge 1 commit into
wasbDepCodeReviewfrom
readAheadDisable

Conversation

@anmolanmol1234

Copy link
Copy Markdown
Collaborator

No description provided.

@saxenapranav saxenapranav left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hope we want to disable readAhead for the whole of parquet file inputStream lifecycle. looks good!

if (shouldReadFully()) {
lastReadBytes = readFileCompletely(b, currentOff, currentLen);
} else if (shouldReadLastBlock()) {
this.readAheadEnabled = false;

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Lets add some comments here for future reference.

@anujmodi2021 anujmodi2021 changed the title disable readAhead for parquet [POC] disable readAhead for parquet Dec 2, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants