Skip to content

Issue 7199 - Test bulk import row and sort key types - #7841

Draft
shriharish1310 wants to merge 1 commit into
gchq:developfrom
shriharish1310:agent/test-bulk-import-key-types
Draft

Issue 7199 - Test bulk import row and sort key types#7841
shriharish1310 wants to merge 1 commit into
gchq:developfrom
shriharish1310:agent/test-bulk-import-key-types

Conversation

@shriharish1310

Copy link
Copy Markdown

Issue

What changed

  • Added integration coverage for LongType, StringType, and ByteArrayType in both row-key and sort-key positions.
  • Runs every key-type case through the DataFrame, RDD, and DataFrame local-sort bulk-import drivers.
  • Verifies the imported Parquet rows preserve their values and are returned in schema-defined key order.

Tests

  • My PR adds tests based on the project test strategy:
    • BulkImportJobDriverIT: 30 tests passed, including 9 new key-type/runner combinations; 0 failures, 0 errors, 0 skipped.
    • mvn --batch-mode -pl bulk-import/bulk-import-runner verify -DrunIT=BulkImportJobDriverIT -DskipRust (Linux container)
    • mvn --batch-mode -pl bulk-import/bulk-import-runner -Pstyle -DskipRust checkstyle:check spotbugs:check

Documentation

  • No documentation change is needed because this is test-only coverage with no user-facing functionality change.
  • No production Java code was added, so no new Javadoc is required.
  • No dependencies were added or removed, so NOTICES is unchanged.

@CLAassistant

Copy link
Copy Markdown

CLA assistant check
Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.
You have signed the CLA already but the status is still pending? Let us recheck it.

@shriharish1310
shriharish1310 force-pushed the agent/test-bulk-import-key-types branch from 5058b21 to 77cd83c Compare August 3, 2026 16:31
@shriharish1310

Copy link
Copy Markdown
Author

Hi maintainers - the CLA Assistant page for this PR loads with an empty Version and no agreement text, so I am unable to review or sign it. I have also updated the commit author identity to match the PR account. Could you please check or refresh the repository's CLA Assistant configuration? Thanks!

@patchwork01

Copy link
Copy Markdown
Collaborator

It looks like that was a temporary problem with the CLA Assistant. The agreement seems to be loading again now, although it takes a few seconds to show. Sorry about that.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Improve testing of row and sort key fields in BulkImportJobDriverIT

3 participants