Skip to content

Make traversal of the zarr + checksumming interleaved via threading #52

Description

@yarikoptic

traversal of folder could be taking awhile since filesystem itself could be slow. It was initially advocated by @satra and later implemented in dandi-cli to get checksumming of zarr folders to become more efficient through doing traversal and checksumming in separate threads, as e.g. done in https://github.com/dandi/dandi-cli/blob/72816ab51a4f168bd9629cc6ac9a6a4edd585bee/dandi/support/digests.py#L101

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions