Quote:
Originally Posted by blacknight  As for choking spiders.. I can't see why that would happen unless you were doing really complex redirects ie. mapping multiple paths to multiple destinations |
'choke' might have been the wrong phrase. The spider has no problems with the content, but how the index is created and redirects are processed may be affected by redirecting large quantities of pages in one go.
In essence the spider will eat it up but the index will spit it out.