Jump to content

Moving a lot of files


brianlange

Recommended Posts

rsync would be better to transfer a large number of files from one server to another.

 

For example, you can run rsync again, and it will check if any files have been modified (since you started the initial copy) and copy them to the new server.

 

There are quite a few switches you can use with rsync. I typically use the following on the new server:

rsync -avz user@server:source destination

 

e.g.

 

rsync -avz user@oldserver:/home/user /home/

 

-steve

Link to comment
Share on other sites

I have about 6 TB of files I need to move from one server to another. I did my best to move it over FTP like below, but the connection dies a lot, and after a certain amount of progress, it disconnects before it even resumes moving files from I presume taking too long to compare files before actually transferring and then timing out.

 

~/ncftp-3.2.3/bin/ncftpput -R -z -v -u "user" -p "password" upload.server.net /local/dir/ remote/dir/

 

I've used rsync. if connection drops it've compare source and destination and sync from where it left (assuming large amount of small to medium files, not 2 x 3 TB :) ).

 

alternatively start apache and make your file dir root and do recursive wget, might work as well, you just need to tell it to ignore files that already exist locally.

 

 

Link to comment
Share on other sites

This thread is more than a year old. Please don't revive it unless you have something important to add.

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

×
×
  • Create New...

Important Information

We have placed cookies on your device to help make this website better. You can adjust your cookie settings, otherwise we'll assume you're okay to continue.