Quote:
Originally Posted by bazzjazz Not sure if this is the correct board for this... |
If the pages are php then you could use something like this:
http://www.modem-help.freeserve.co.u...-block.php.txt Not really a player any more.
A waste of bandwidth.
Never heard of this one. Sounds like a maggot/scraper.
Can't remember seeing this as a legit spider user agent.
There's a pile more that should be in there. And also look into including a scraper/ bad bot trap to block scrapers.
Keep an eye on this forum:
Search Engine Spider Identification:
Block all Chinese/Korean nets if necessary. Only allow users from the markets that the site is meant to serve if you really want to control access.
Regards...jmcc