If you have SSH access to the server you are moving to, you can login and copy the files directly server to server. Even with FTP, this should be multiples faster than downloading local and back up again.