Skip to content

show progress on preprocessing jobs? #4

@jeremydouglass

Description

@jeremydouglass

Consider adding a counter and displaying e.g. "13 out of 50" to show current progress through zip jobs -- in log file or terminal or both.

Could (also) compute total estimated bytes by getting the size of each zip e.g. with bytecount = os.path.getsize(zipfile), adding them up, and then keeping a running progress of how much of the total bytecount has been worked through that is updated each time a zip completed. This would address the issue that some zips are hundreds or thousands of times larger than others.

https://stackoverflow.com/questions/6591931/getting-file-size-in-python

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions