Skip to content

[Json] Add benchmarks for list json reader - #9507

Merged
alamb merged 4 commits into
apache:mainfrom
liamzwbao:issue-9497-list-json-reader-bench
Mar 11, 2026
Merged

[Json] Add benchmarks for list json reader#9507
alamb merged 4 commits into
apache:mainfrom
liamzwbao:issue-9497-list-json-reader-bench

Conversation

@liamzwbao

@liamzwbao liamzwbao commented Mar 5, 2026

Copy link
Copy Markdown
Contributor

Which issue does this PR close?

Rationale for this change

Add benchmark for ListArray in json_reader to support the performance evaluation of #9497

What changes are included in this PR?

  • Benchmarks for decoding and serialize json list to ListArray.
  • Benchmarks for ListArray and FixedSizeListArray json writer

Are these changes tested?

Benchmarks only

Are there any user-facing changes?

No

@github-actions github-actions Bot added the arrow Changes to the arrow crate label Mar 5, 2026
@liamzwbao
liamzwbao marked this pull request as ready for review March 5, 2026 01:37
@liamzwbao
liamzwbao force-pushed the issue-9497-list-json-reader-bench branch from 7219290 to cfaea69 Compare March 5, 2026 01:59
Comment thread arrow-json/benches/json_writer.rs Outdated
group.throughput(Throughput::Elements(ROWS as u64));
group.bench_function("short", |b| {
b.iter(|| {
let mut buf = Vec::with_capacity(ROWS * LIST_SHORT_ELEMENTS * 8);

This comment was marked as resolved.

Comment thread arrow-json/benches/json_writer.rs Outdated
Comment thread arrow-json/benches/json_writer.rs Outdated
Comment thread arrow-json/benches/json_writer.rs Outdated
@liamzwbao
liamzwbao force-pushed the issue-9497-list-json-reader-bench branch from 82a8e0a to 1e5f581 Compare March 10, 2026 23:52

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you for making the file name consistent

@alamb alamb left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @liamzwbao -- looks good to me

@alamb
alamb merged commit a475f84 into apache:main Mar 11, 2026
24 checks passed
@alamb

alamb commented Mar 11, 2026

Copy link
Copy Markdown
Contributor

Thanks for the review @Rafferty97

@liamzwbao
liamzwbao deleted the issue-9497-list-json-reader-bench branch March 11, 2026 22:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

arrow Changes to the arrow crate

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants