Skip to content

Partial updates do not support incremental query #18943

@phanikumars

Description

@phanikumars

Bug Description

What happened:
The incremental query does not return values for all columns in the table when we make a partial update; instead, it returns only the fields that changed as part of the partial update.

What you expected:
The incremental query should return all fields in the table. Due to this issue, we end up joining the table again to get the complete row, which is a performance hit.

https://apache-hudi.slack.com/archives/C4D716NPQ/p1770644265230019

Environment

Table type
MOR
Hudi version:
Hudi 1.1
Query engine: (Spark/Flink/Trino etc)
Spark

Logs and Stack Trace

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    type:bugBug reports and fixes

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions