Svnloadsub skipping load of revisions - #17

Open

omanikhi wants to merge 19 commits into

svnloadsub-rev-skipping-fix

Commits on May 7, 2024

Improve the execute() function allowing it to take in stdin data.
omanikhi
committed
Use execute() to run commands and refactored the file fixing some PEP 8 warnings.
omanikhi
committed
Some more refactoring and PEP 8 fixes.
omanikhi
committed
Added a --log-level argument and suppressed the unnecessary boto3 debug logs.
omanikhi
committed
Fixed a logical issue and revived the maximum number of shards error.
omanikhi
committed
Check the youngest revision and compare it against the last commit restored from the dump.
omanikhi
committed
Rewrote the _load_zip method avoiding buffers as the dumps can be quite large
omanikhi
committed
Re-implemented the execute() function reading it chunk by chunk instead of entirely loading it to the memory.
omanikhi
committed
Re-wrote the dump_zip_upload() method using the disk instead of the memory to keep the data.
omanikhi
committed
Added a check that makes sure the modified paths in the restored shard0 revision matches those in the dump file.
omanikhi
committed
Improved the execute() function fixing an issue that prevented it from reading the entire stdout/stderr.
omanikhi
committed
Simplified the execute() logic.
omanikhi
committed
Clean up corresponding shard0 after successfully dumping a shard3.
omanikhi
committed
Use the common bgworker and daemon modules instead of the duplicated code.
omanikhi
committed
Improved exception handling when a commit fails to be queued so it wouldn't crash the daemon.
omanikhi
committed

Commits on May 8, 2024

Improved the validation following the review comments.
omanikhi
committed

Commits on May 17, 2024

Reverted the dump_zip_upload to its previous implementation to avoid using the disk.
omanikhi
committed

Commits on May 21, 2024

Comparing changed paths is now done before restoring a shard0 and between the previous shard and the last rev.
omanikhi
committed

Commits on May 22, 2024

Added support for the PID file locking to svnloadsub.
omanikhi
committed