Irish SEO,  Marketing & Webmaster Discussion

 

Best way to upload large files to server?

This is a discussion on Best way to upload large files to server? within the Server / Technical Administration Tips and Queries forums, part of the Webmaster Help category; Hi guys, I'm looking to upload 100 gigs or more of stuff to my server...however...obviously its taking a long time. ...


Go Back   Irish SEO, Marketing & Webmaster Discussion > Webmaster Help > Server / Technical Administration Tips and Queries

Register Forum Rules FAQDonate Calendar Search Today's Posts Mark Forums Read

  1 links from elsewhere to this Post. Click to view. #1 (permalink)  
Old 18-11-2008, 12:14 PM
musicformedia's Avatar
Wannabe Geek
 
Join Date: Mar 2008
Posts: 141
Nominated 3 Times in 2 Posts
Nominated TOTW/F/M Award(s): 1
musicformedia will become famous soon enough
Default Best way to upload large files to server?

Hi guys,
I'm looking to upload 100 gigs or more of stuff to my server...however...obviously its taking a long time. Now I have 24mg bb with a 1:1 contention ratio, so there is a good upload and download speed. However, I'm using filezilla ftp to try and upload, and its timing out and having to reconnect, which is causing the file to not upload correctly.

Each file is about 4 gigs at the most - is there nothing like Free Download Manager (which splits files into four parts and then download all four parts at the same time) out there? Any help would be appreciated as I know my upload speed is a lot better than 50 kb - did a speedtest and it gave an upload speed of about a meg - I know it depends on your connection to your server aswell...but surely it should be faster no?
__________________
www.soundtrack.ie
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Spurl this Post!Reddit! Wong this Post!
Reply With Quote
  #2 (permalink)  
Old 18-11-2008, 01:22 PM
n3tFl0w's Avatar
Wannabe Geek
 
Join Date: Jan 2008
Location: Work...
Posts: 445
Nominated 0 Times in 0 Posts
TOTW/F/M Award(s): 0
n3tFl0w is a splendid one to beholdn3tFl0w is a splendid one to beholdn3tFl0w is a splendid one to beholdn3tFl0w is a splendid one to beholdn3tFl0w is a splendid one to beholdn3tFl0w is a splendid one to beholdn3tFl0w is a splendid one to behold
Default

You could manually split the files - Here's what I use. Never tried it on 4gb files though.... HJ-Split - Utilities & Drivers - File & Disk Management - Downloads - CNET Australia

If it doesn't work, I can find out what "certain" people use for "certain" tasks...

EDIT: http://www.freebyte.com/hjsplit/#java its the jave version that I use on my mac. Don't remember if I got it from this website though so make sure your AV is up to date...
__________________
My Blog thing!

Last edited by n3tFl0w; 18-11-2008 at 01:30 PM..
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Spurl this Post!Reddit! Wong this Post!
Reply With Quote
  #3 (permalink)  
Old 18-11-2008, 01:23 PM
n3tFl0w's Avatar
Wannabe Geek
 
Join Date: Jan 2008
Location: Work...
Posts: 445
Nominated 0 Times in 0 Posts
TOTW/F/M Award(s): 0
n3tFl0w is a splendid one to beholdn3tFl0w is a splendid one to beholdn3tFl0w is a splendid one to beholdn3tFl0w is a splendid one to beholdn3tFl0w is a splendid one to beholdn3tFl0w is a splendid one to beholdn3tFl0w is a splendid one to behold
Default

As for your upload speed - 1 meg sounds about right. Irish company are very very stingy with BB upload bandwidth and take the Asycnhronous part of ADSL very literally!
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Spurl this Post!Reddit! Wong this Post!
Reply With Quote
  #4 (permalink)  
Old 18-11-2008, 01:46 PM
paul's Avatar
ninja SEO
 
Join Date: Dec 2006
Location: .de
Posts: 1,251
Nominated 0 Times in 0 Posts
TOTW/F/M Award(s): 0
paul has much to be proud ofpaul has much to be proud ofpaul has much to be proud ofpaul has much to be proud ofpaul has much to be proud ofpaul has much to be proud ofpaul has much to be proud ofpaul has much to be proud ofpaul has much to be proud ofpaul has much to be proud of
Default

I'd post the drive to your hosting company. 100GB would take a few days and you risk data corruption (bit error rates and all that)
__________________
my sites :
irish poker / irish jobs / seo faq / advertise jobs free / green card / skiing
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Spurl this Post!Reddit! Wong this Post!
Reply With Quote
  #5 (permalink)  
Old 18-11-2008, 02:25 PM
Wannabe Geek
 
Join Date: Feb 2007
Posts: 339
Nominated 0 Times in 0 Posts
TOTW/F/M Award(s): 0
hosting365 will become famous soon enough
Default

Courier or personally drop the disk to your host, and let them upload locally.

Trying to move that much content over the interweb will just give you grey hair!
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Spurl this Post!Reddit! Wong this Post!
Reply With Quote
  #6 (permalink)  
Old 18-11-2008, 02:41 PM
musicformedia's Avatar
Wannabe Geek
 
Join Date: Mar 2008
Posts: 141
Nominated 3 Times in 2 Posts
Nominated TOTW/F/M Award(s): 1
musicformedia will become famous soon enough
Default

Just asked bluehost - they won't accept a hard drive to be uploaded locally..."no other way" apparently, other than uploading it all manually...well this will be fun lol...

Thanks for the ideas...its a shame my upload speed is so slow...really want to get this stuff up this week
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Spurl this Post!Reddit! Wong this Post!
Reply With Quote
  #7 (permalink)  
Old 18-11-2008, 02:44 PM
Wannabe Geek
 
Join Date: Feb 2007
Posts: 339
Nominated 0 Times in 0 Posts
TOTW/F/M Award(s): 0
hosting365 will become famous soon enough
Default

Ah that explains it - connecting out of Ireland is slowing the transfer down a lot more.

One option would be to give the content to your local friendly host, who could transfer the files over the 'backbone' so to speak - at least you'd get the max possible upload rates permitted by bluehost...
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Spurl this Post!Reddit! Wong this Post!
Reply With Quote
  #8 (permalink)  
Old 18-11-2008, 02:49 PM
musicformedia's Avatar
Wannabe Geek
 
Join Date: Mar 2008
Posts: 141
Nominated 3 Times in 2 Posts
Nominated TOTW/F/M Award(s): 1
musicformedia will become famous soon enough
Default

Yea...im starting to see the flaws of bluehost now, and websites that offer "unlimited hosting" and "unlimited bandwith"...seem to have a nice little fair usage policy in them aswell - making the phrase unlimited pointless...

Ah well...I'll see how this goes. Its only about 25 videos you see - and they're about 4-5 gigs each. I need to figure out a way to convert them down so they are a lot smaller in the first place. How do people manage to get 4.5 gig dvds down to 700mb - if I can figure this out, then I should cut the upload time of the stuff in half at least...

I still can't seem to figure it out
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Spurl this Post!Reddit! Wong this Post!
Reply With Quote
  #9 (permalink)  
Old 18-11-2008, 03:40 PM
niall's Avatar
Hosting Caretaker
 
Join Date: Jan 2007
Location: Carlow
Posts: 82
Nominated 0 Times in 0 Posts
TOTW/F/M Award(s): 0
niall will become famous soon enough
Send a message via ICQ to niall Send a message via MSN to niall
Default

Quote:
Originally Posted by musicformedia View Post
Ah well...I'll see how this goes. Its only about 25 videos you see - and they're about 4-5 gigs each. I need to figure out a way to convert them down so they are a lot smaller in the first place. How do people manage to get 4.5 gig dvds down to 700mb - if I can figure this out, then I should cut the upload time of the stuff in half at least...

I still can't seem to figure it out
You could try converting them to avi using the xvid codec for video and mp3 for audio. I used to use DVD::Rip to do this, and there's also mencoder. I only run linux boxs here, so I'm not sure what the equivilent is on Windows or Mac.
__________________
Blog
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Spurl this Post!Reddit! Wong this Post!
Reply With Quote
Reply

Tags
files, large, server, upload

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On


LinkBacks (?)
LinkBack to this Thread: http://www.irishwebmasterforum.com/server-technical-administration-tips-and-queries/7401-best-way-upload-large-files-server.html

Posted By For Type Date
Hilium - Best way to upload large files to server? This thread Refback 18-12-2008 09:08 PM

Similar Threads

Thread Thread Starter Forum Replies Last Post
Help with Large Video wildSaffy Server / Technical Administration Tips and Queries 4 20-03-2008 11:58 PM
Server 'log' files - can I delete? ButtermilkJack Server / Technical Administration Tips and Queries 3 20-09-2007 07:03 PM
Delete Or Redirect Files From Server? Peter McC Webmaster Discussion 4 14-02-2007 12:32 PM


Sponsored links

Pepperjam Network
Paid On Results www.zanox.com


All times are GMT +1. The time now is 01:39 PM.


Powered by: vBulletin Version 3.8.2, Copyright ©2000 - 2009, Jelsoft Enterprises Limited.
Hosted in Ireland by Blacknight - Test your ISP |Irish Hosting Directory| Armchair.ie|Logo by Eden Web Design|Avatars by Afterglow |Latest Blog Entries | VPS HostingAd Management by RedTyger

Search Engine Friendly URLs by vBSEO 3.3.0

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51