How can I download a directory with many files from my Linode?
Linode
Linode Staff
I would like to download a directory with many files (20GB) from the Linode server. How would you recommend to make it? I assume that a simple copy won't work.
1 Reply
Usually, you can do this with a tool such as FileZilla or rsync.
However, since you're planning to download such a large volume of data, the main concerns are a consistent internet connection as well as a tool that verifies the completeness of the download.
For this purpose, I'd recommend using rsync. This tool performs a checksum on the files and even resumes failed transfers. Please see An Introduction to Rsync for more details.
You can check to make sure its installed on your Linode with the following command:
rsync -version
If its not installed, you can use the appropriate command depending on your Linux distribution:
Ubuntu/Debian
apt-get install rsync
CentOS/Fedora
yum install rsync
Then, from the machine you'd like to transfer the directory to, you may use the following command. In this command you are sending data from your Linode to your local Desktop.
$ rsync -za username@[linode.ip.address]:~/[directory] ~/[destination to send the directory]
I'd also like to include the Rsync Man Page and RSync FAQ Page for your reference.
Hope this helps!