Quote:
Originally Posted by Forbairt  alphabetically ... could be broken down further into ..
a -> aa ... ab ... ac .... th -> the...
listing them alphabetically with just the initial letter wouldn't make too much sense to me ... (unless it was something like dropped irish domains) |
Yep. This would narrow it down a bit.
Quote:
|
Also .. if you start getting spidered 190 million page hits could be ouch ... not to mention bots potentially collecting all the data from your system (though you've probably thought of that already)
|
It gives me nightmares.
Google is ok. But the morons in Microsoft and Yahoo with their multitude of braindead spiders would be continually hammering the sites. As for the scrapers, I have no problem with banning entire countries or Class A if they irritate me. The trick is maintaining a healthy balance between giving genuine users the info they want and blocking maggots.
Regards...jmcc