Irish SEO,  Marketing & Webmaster Discussion

 

stopping heavy downloaders

This is a discussion on stopping heavy downloaders within the Server / Technical Administration Tips and Queries forums, part of the Webmaster Help category; I've been hit lately with heavy downloaders of my content, I check my logs and some IPs are downloading 1 ...


Go Back   Irish SEO, Marketing & Webmaster Discussion > Webmaster Help > Server / Technical Administration Tips and Queries

Register Forum Rules FAQDonate Members List Calendar Search Today's Posts Mark Forums Read


Notices

Reply

 

LinkBack Thread Tools Display Modes
  #1 (permalink)  
Old 12-03-2007, 08:49 PM
georgiecasey's Avatar
Member
 
Join Date: Jul 2006
Location: Galway / Ennis
Posts: 277
Nominated 0 Times in 0 Posts
TOTW/F/M Award(s): 0
georgiecasey will become famous soon enough
Send a message via ICQ to georgiecasey
Default stopping heavy downloaders

I've been hit lately with heavy downloaders of my content, I check my logs and some IPs are downloading 1 or two gigabytes a day, obviously scrapers. Anyone know of a good technique to stop this? I was thinking a script activated by cron every half hour that checks the end of the apache log file and bans IPs based on downloaded data, allowing Google, MSN and Yahoo IPs obviously. Anyone know of anything like this or better?
__________________

My Blog
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Spurl this Post!Reddit! Wong this Post!
Reply With Quote
  #2 (permalink)  
Old 12-03-2007, 10:24 PM
Busarus's Avatar
Wannabe Geek
Recent Blog: Scrum Thoughts
 
Join Date: Sep 2006
Location: Monaghan, Ireland
Posts: 225
Nominated 0 Times in 0 Posts
TOTW/F/M Award(s): 0
Busarus will become famous soon enough
Default

are you sure it's not any of the bots from google or yahoo?
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Spurl this Post!Reddit! Wong this Post!
Reply With Quote
  #3 (permalink)  
Old 13-03-2007, 12:41 AM
georgiecasey's Avatar
Member
 
Join Date: Jul 2006
Location: Galway / Ennis
Posts: 277
Nominated 0 Times in 0 Posts
TOTW/F/M Award(s): 0
georgiecasey will become famous soon enough
Send a message via ICQ to georgiecasey
Default

nah, i checked the ips. google and yahoo always have a reverse lookup, im nearly sure. and the ips are downoading media files, google and yahoo dont download them
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Spurl this Post!Reddit! Wong this Post!
Reply With Quote
  #4 (permalink)  
Old 13-03-2007, 01:21 AM
blacknight's Avatar
Web Slave
Recent Blog:
 
Join Date: Jan 2006
Location: Ireland
Posts: 6,521
blacknight is a splendid one to beholdblacknight is a splendid one to beholdblacknight is a splendid one to beholdblacknight is a splendid one to beholdblacknight is a splendid one to beholdblacknight is a splendid one to beholdblacknight is a splendid one to behold
Send a message via ICQ to blacknight Send a message via AIM to blacknight Send a message via MSN to blacknight
Default

What UserAgent are they using?
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Spurl this Post!Reddit! Wong this Post!
Reply With Quote
  #5 (permalink)  
Old 18-03-2007, 08:58 PM
Frontpage User
 
Join Date: Mar 2007
Posts: 1
Nominated 0 Times in 0 Posts
TOTW/F/M Award(s): 0
TChar will become famous soon enough
Thumbs down "Your" content?

Nice collection of ringtones you have on your site Georgie. I wonder where they've come from...? Oh wait, you've scraped every single on of them from other websites and you have the audacity to moan that you're now being scraped.

Why not explain to everyone here how you're actively (like, right now) scraping a certain few sites of currently no less than 150,000 mp3 files, and counting.

I suggest you quit doing stuff that you don't like done to yourself, or you'll just face more problems.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Spurl this Post!Reddit! Wong this Post!
Reply With Quote
Reply

Tags
downloaders, heavy, stopping

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On
Forum Jump

Similar Threads

Thread Thread Starter Forum Replies Last Post
Stopping Spam - Closing Old Threads blacknight Forum Management 0 16-01-2007 10:34 AM


Sponsored links

Paid On Results


All times are GMT +1. The time now is 12:14 PM.


Powered by: vBulletin Version 3.7.3, Copyright ©2000 - 2008, Jelsoft Enterprises Limited.
Hosted in Ireland by Blacknight - Test your ISP |Irish Hosting Directory| Armchair.ie|Logo by Eden Web Design|Avatars by Afterglow |Latest Blog Entries | VPS HostingAd Management by RedTyger

Search Engine Friendly URLs by vBSEO 3.2.0