| |
09-04-2008, 06:37 PM
| |||||
| |||||
 Files/Directories being indexed I was doing a little link checking on Derek Knight Photography and notice that Google, Yahoo, MSN etc are all indexing parts of the sites such as Index of /commercial/cfw Index of /commercial/europa etc etc There are no pages there - just views of the directories etc and old pages which are half new design and half old. Is there a good way to stop this from happening and what are the consequences? Thanks all!
__________________ Peter Knight - Web Designer .................................................. .................................................. Eden Web - Web Design Ireland Virtual Tour Company Dublin Photographer Last edited by EdenWeb; 09-04-2008 at 07:04 PM.  |
|
09-04-2008, 07:32 PM
| ||||
| ||||
| remove directory browsing on the server would stop it
__________________ David Behan Web Design Ireland | Mortgages | Memorial Websites | Digital Printing |
|
09-04-2008, 07:43 PM
| |||||
| |||||
| You could block most search engines via a robots.txt with explicit DENY rules
__________________ Hosting & Domains|Plesk Vps Hosting|Blog Tips|Films.ie|Gadgets|Monetisation Tips|Movie Chat Energise your forum! Click here for info |
|
10-04-2008, 08:55 AM
| |||||
| |||||
| Quote:
__________________ Peter Knight - Web Designer .................................................. .................................................. Eden Web - Web Design Ireland Virtual Tour Company Dublin Photographer |
|
10-04-2008, 09:21 AM
| |||||
| |||||
| As Michele said ... I'd do the robots thing ... Code: User-agent: * Disallow: /directory1/ Disallow: /directory2/ Disallow: /directory3/ to your .htaccess file you can add Code: IndexIgnore */* 
__________________ Forbairt Media | Web Design & Development Galway / Dublin, Ireland - coming soon ... ( vague but descriptive isn't it ) Recent Work: Safari Club African Safari Holidays - South Africa Safaris Other Stuff: FluffyLinkulator Rapid Inclusion Service Tools |
|
10-04-2008, 09:31 AM
| ||||
| ||||
| robots.txt would work too but I think directory browsing should be turned off anyway. You never know what someone might stumble across, ya know!
__________________ David Behan Web Design Ireland | Mortgages | Memorial Websites | Digital Printing |
|
10-04-2008, 01:33 PM
| ||||
| ||||
| Personally I have directory indexing turned off and I pop specific folders I don't want accessed into my robots.txt file 
__________________ Web Design Ireland |
 |
| Thread Tools | |
| Display Modes | |
|
|
Similar Threads | ||||
| Thread | Thread Starter | Forum | Replies | Last Post |
| How to Avoid the Google Sandbox | Cormac | Webmaster Articles | 26 | 18-02-2008 04:38 AM |
| 301 redirects - how long? | TheMenace | Search Engine Optimisation | 4 | 06-09-2007 09:21 PM |
Linear Mode
