type:devtask Implement columnar batch reading for Lance

[rahil-c]

Task Description

Currently we have implemented row based reading within #17660 (comment) leveraging InternalRow directly.

For future task we should look into directly reading ColumnarBatch

Task Type

Code improvement/refactoring

Related Issues

Parent feature issue: (if applicable )
Related issues:
NOTE: Use Relationships button to add parent/blocking issues after issue is created.

[KiteSoar]

Hi @rahil-c, can you assign this issue to me?

[rahil-c]

Hi @KiteSoar let us know if you are working on this, if not maybe @wombatu-kun can take a look if he has time.

[KiteSoar]

Hi @KiteSoar let us know if you are working on this, if not maybe @wombatu-kun can take a look if he has time.

Hi @rahil-c，feel free to assign this to someone else. I've been busy with graduation matters recently and won't be able to work on this task right now. I'll come back to contribute to Hudi once I've finished my graduation work.

[rahil-c]

@wombatu-kun If you are interested in taking this up whenever no rush and thanks again for your efforts we appreciate it! Otherwise i can try taking this up at some point

cc @yihua @voonhous @vinothchandar

[wombatu-kun]

ok, i'll try