According to the paper mention:
import pyarrow.dataset as ds
format_ = ds.SkyhookFileFormat( "parquet", "/ceph.conf" )
But for the skyhook build, when set up "ARROW_SKYHOOK=ON", there is no "libarrow_skyhook_client.so" library generate. SkyhookFileFormat API can not be used.
According to the paper mention:
import pyarrow.dataset as ds
format_ = ds.SkyhookFileFormat( "parquet", "/ceph.conf" )
But for the skyhook build, when set up "ARROW_SKYHOOK=ON", there is no "libarrow_skyhook_client.so" library generate. SkyhookFileFormat API can not be used.