Skip to content
GitLab
Explore
Sign in
Primary navigation
Search or go to…
Project
R
remote_tree_to_local_tars
Manage
Activity
Members
Labels
Plan
Issues
Issue boards
Milestones
Wiki
Code
Merge requests
Repository
Branches
Commits
Tags
Repository graph
Compare revisions
Snippets
Build
Pipelines
Jobs
Pipeline schedules
Artifacts
Deploy
Releases
Container Registry
Model registry
Operate
Environments
Monitor
Incidents
Analyze
Value stream analytics
Contributor analytics
CI/CD analytics
Repository analytics
Model experiments
Help
Help
Support
GitLab documentation
Compare GitLab plans
Community forum
Contribute to GitLab
Provide feedback
Keyboard shortcuts
?
Snippets
Groups
Projects
Admin message
GitLab Downtime Notice
Date: Monday, 28 April Time: 9:00 AM – 12:00 PM (AEST) Reason: System patching to version 17.10.5
Show more breadcrumbs
Gary Ruben
remote_tree_to_local_tars
Graph
56d7f62931a790d0604fde16b2c13d40e3cb33c6
Select Git revision
Branches
1
master
default
protected
1 result
You can move around the graph by using the arrow keys.
Begin with the selected commit
Created with Raphaël 2.2.0
10
Sep
6
Aug
4
20
Jul
17
7
May
6
28
Apr
27
12
Jun
19
Mar
15
14
12
7
6
5
explicitly escaped parentheses in paths
master remote_m…
master remote_mirror_39d57014c042fdcc902a0171443f820e/master
reformed tar line to avoid leading period slash in filenames and match cpio behaviour
Cleaned up commented-out code that treated single files specially.
Changes to use Fabric Connection properly, and change from cpio to tar to support >2GB files
Heavy rewrite to use Fabric's context managers as intended, but requiring a bugfix.
Removed some assertions to better support local operation
Prepended some commands with nice at Ron Bosworth's request, to reduce CPU impact on the synchrotron side.
fixed md5sum line to stop it breaking on lines with special characters
changed from embedded paths to commandline commands
Added a display pickle file option
Changed to use commandline instead of hardcoded options
first version
changed the way lines_in() works
Add LICENSE
readme for gitlab
A script to verify a tree of tarballs against .md5 files
documentation improvements
Changed single file send to use scp
Change counting newlines to calling splitlines() to account for a last line having no newline.
fixed file count logic
Reset the READ_PICKLE_FILE flag state
Improved recovery logic that caused nodes to be marked processed upon a network failure so we just roll back to the last successful transfer of a nonzero node
added .gitignore
A script to generate and transfer md5 checksum files from a remote/source server
reconciling today's changes; just the find command wascleaned up
improved find command to avoid leading ./ on paths
Improvements to printing useful things to the log file
Tidying and documentation improvement
Added some stdout logging functionality
Added file count to node object and got tree pickling recovery working
Replaced os.system with subprocess.run and added node.processed flag
Changes to ignore empty nodes and tarring single files.
Initial commit
Loading