Thread: Crawlers, robots and excessive bandwidth
View Single Post

  #6 (permalink)  
Old 29-04-2008, 12:04 PM
ghost's Avatar
ghost ghost is offline
Wannabe Geek
  
Join Date: Dec 2007
Location: Ennis
Posts: 176
Nominated 0 Times in 0 Posts
TOTW/F/M Award(s): 0
ghost will become famous soon enough
Default robots and crawlers
Quote:
Originally Posted by bazzjazz View Post
Total bandwidth for my shared server this month is about 130gb and most of this is robots crawling various sites.
50gbs seems excessive could you post (attach) your server log for us to view.
Reply With Quote