Very cool package! As someone working in climate science, I appreciate this problem a lot. In the python world, we use zarr + dask to achieve some of the features you are going for.
I saw your post where you mentioned your package might eventually interoperate with zarr. That would be awesome, because we have started putting a lot of climate date in Google Cloud Storage as zarr arrays (see https://pangeo-data.github.io/pangeo-datastore/). I would really like julia users to have a way to compute on this data.
We have discussed zarr + julia a lot in zarr-developers/community#17. I know @meggart has his own julia + zarr work too. So I just thought I would open an issue to enquire about the status. Is there any we we (zarr developers) could collaborate or help on this?
Very cool package! As someone working in climate science, I appreciate this problem a lot. In the python world, we use zarr + dask to achieve some of the features you are going for.
I saw your post where you mentioned your package might eventually interoperate with zarr. That would be awesome, because we have started putting a lot of climate date in Google Cloud Storage as zarr arrays (see https://pangeo-data.github.io/pangeo-datastore/). I would really like julia users to have a way to compute on this data.
We have discussed zarr + julia a lot in zarr-developers/community#17. I know @meggart has his own julia + zarr work too. So I just thought I would open an issue to enquire about the status. Is there any we we (zarr developers) could collaborate or help on this?