Motivation
Currently, we only support get_object/put_object which handles the whole object. But for the large object, a stream fuction will be helpful for pipeline, e.g. uploading while downloading to cache. This feature will support read_object/write_object to handle object in streaming way.
Function Specification
Add read_object/write_object in flamepy
Solutions
Use do_get/do_put in flight which already streaming gRPC
Additional context
N/A
Motivation
Currently, we only support get_object/put_object which handles the whole object. But for the large object, a stream fuction will be helpful for pipeline, e.g. uploading while downloading to cache. This feature will support read_object/write_object to handle object in streaming way.
Function Specification
Add read_object/write_object in flamepy
Solutions
Use do_get/do_put in flight which already streaming gRPC
Additional context
N/A