This is a discussion on Robot Text within the Coding Help forums, part of the Webmaster Help category; I need a little help understanding the robot text analysis of my site. Does anyone here specailise/understand this stuff I ...
| |||||||
| Register | Forum Rules | FAQ | Donate | Members List | Calendar | Search | Today's Posts | Mark Forums Read |
| |||||
| Caz I've a fairly code understanding of it. What do you need to know? Michele
__________________ Hosting & Domains|Plesk Vps Hosting|Blog Tips|Films.ie|Gadgets|Monetisation Tips|Movie Chat Energise your forum! Click here for info |
| ||||
| Hi Michelle, The robot.txt validator I am using is showing a series or errors all more or less the same as this; ERROR Invalid Line: <!doc type html public "-//W3C//DTD HTML 4.01 transitional// EN"> I did not build the site myself and have no coding experience whatsoever. However I've learnt a lot over the last couple of months and have found some things that concern me about our site a little. I am convinced that the SE are having trouble reading the pages, although I know that this could be due to an inherent problem with osCommerce, it might also be this. Any help with clarification is greatly appreciated, thanks C. |
| |||||
| Could you give me link to the page you are checking? It looks like you may have made an error with your document type declaration... Though that has nothing to do with robots
__________________ Hosting & Domains|Plesk Vps Hosting|Blog Tips|Films.ie|Gadgets|Monetisation Tips|Movie Chat Energise your forum! Click here for info |
| ||||
| I can't send you the link as it's a subsrciption based service. I typed in http://www.ardoafoodandwine.com/robots.txt I think this is right? Thanks C. |
| |||||
| That's giving a 404 ie. there is no robots.txt file
__________________ Hosting & Domains|Plesk Vps Hosting|Blog Tips|Films.ie|Gadgets|Monetisation Tips|Movie Chat Energise your forum! Click here for info |
| ||||
| Hi Michelle, So what I'm typing in is wrong? Do you know what I need to put in? Sorry, I just can't seem to find the answer anywhere within the programme I'm working on and as your probably aware by now I'm not exactly an expert. Many thanks C. |
| |||||
| Caz Maybe if you told us what you were trying to do exactly we would be able to help you Michele
__________________ Hosting & Domains|Plesk Vps Hosting|Blog Tips|Films.ie|Gadgets|Monetisation Tips|Movie Chat Energise your forum! Click here for info |
| |||||
| robots.txt file should be farely simple. you tell the robots that follows the rules what directory to spider and which one not. Also not a very good ideea as you give the secret directories out for the ones that aren't really just visitors. in the robots.txt file you choose what spiders should index your website and what not. An example: User-agent: *Disallow: /secure/Disallow: /images/that tells all robots not to spider the /secure and /images folders.Everything else is ok.a better way of protecting a directory is to have it based on login and valid session.
__________________ :. Web Design & Development Web Design Ireland :. Search Engines Optimization Search Engines Optimization :. Directory Submission Directory Submission :. News & Press Release Ireland GiveItSocks.com :. Used Cars Ireland, Car Parts & Car Audio Cars For Sale, Car Parts & Accessories :. I Have 2 Find It Directory SEF Directory |
| Tags |
| robot, text |
| Thread Tools | |
| Display Modes | |
|
|
| ||||
| Thread | Thread Starter | Forum | Replies | Last Post |
| HTML Email or Plain Text? | blacknight | Email Marketing | 14 | 04-03-2007 07:43 PM |
| Text / code editors? | blacknight | Coding Help | 9 | 16-05-2006 09:13 AM |
| Adsense Text Links | blacknight | Google Adsense | 0 | 21-04-2006 02:31 AM |