Irish SEO,  Marketing & Webmaster Discussion

 

Robot Text

This is a discussion on Robot Text within the Coding Help forums, part of the Webmaster Help category; I need a little help understanding the robot text analysis of my site. Does anyone here specailise/understand this stuff I ...


Go Back   Irish SEO, Marketing & Webmaster Discussion > Webmaster Help > Coding Help

Register Forum Rules FAQDonate Members List Calendar Search Today's Posts Mark Forums Read


Notices

Reply

 

LinkBack Thread Tools Display Modes
  #1 (permalink)  
Old 17-06-2006, 01:06 PM
Caz Caz is offline
Frontpage User
 
Join Date: May 2006
Posts: 16
Nominated 0 Times in 0 Posts
TOTW/F/M Award(s): 0
Caz will become famous soon enough
Default Robot Text

I need a little help understanding the robot text analysis of my site. Does anyone here specailise/understand this stuff I am completely lost?

Thanks Caz.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Spurl this Post!Reddit! Wong this Post!
Reply With Quote
  #2 (permalink)  
Old 17-06-2006, 06:36 PM
blacknight's Avatar
Web Slave
 
Join Date: Jan 2006
Location: Ireland
Posts: 6,022
blacknight is just really niceblacknight is just really niceblacknight is just really niceblacknight is just really nice
Send a message via ICQ to blacknight Send a message via AIM to blacknight Send a message via MSN to blacknight
Smile

Caz

I've a fairly code understanding of it.

What do you need to know?

Michele
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Spurl this Post!Reddit! Wong this Post!
Reply With Quote
  #3 (permalink)  
Old 17-06-2006, 08:15 PM
Caz Caz is offline
Frontpage User
 
Join Date: May 2006
Posts: 16
Nominated 0 Times in 0 Posts
TOTW/F/M Award(s): 0
Caz will become famous soon enough
Default

Hi Michelle,

The robot.txt validator I am using is showing a series or errors all more or less the same as this;

ERROR Invalid Line:
<!doc type html public "-//W3C//DTD HTML 4.01 transitional// EN">

I did not build the site myself and have no coding experience whatsoever. However I've learnt a lot over the last couple of months and have found some things that concern me about our site a little. I am convinced that the SE are having trouble reading the pages, although I know that this could be due to an inherent problem with osCommerce, it might also be this.

Any help with clarification is greatly appreciated, thanks C.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Spurl this Post!Reddit! Wong this Post!
Reply With Quote
  #4 (permalink)  
Old 17-06-2006, 09:04 PM
blacknight's Avatar
Web Slave
 
Join Date: Jan 2006
Location: Ireland
Posts: 6,022
blacknight is just really niceblacknight is just really niceblacknight is just really niceblacknight is just really nice
Send a message via ICQ to blacknight Send a message via AIM to blacknight Send a message via MSN to blacknight
Default

Could you give me link to the page you are checking?

It looks like you may have made an error with your document type declaration...

Though that has nothing to do with robots
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Spurl this Post!Reddit! Wong this Post!
Reply With Quote
  #5 (permalink)  
Old 17-06-2006, 09:13 PM
Caz Caz is offline
Frontpage User
 
Join Date: May 2006
Posts: 16
Nominated 0 Times in 0 Posts
TOTW/F/M Award(s): 0
Caz will become famous soon enough
Default

I can't send you the link as it's a subsrciption based service. I typed in http://www.ardoafoodandwine.com/robots.txt

I think this is right? Thanks C.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Spurl this Post!Reddit! Wong this Post!
Reply With Quote
  #6 (permalink)  
Old 18-06-2006, 09:59 AM
blacknight's Avatar
Web Slave
 
Join Date: Jan 2006
Location: Ireland
Posts: 6,022
blacknight is just really niceblacknight is just really niceblacknight is just really niceblacknight is just really nice
Send a message via ICQ to blacknight Send a message via AIM to blacknight Send a message via MSN to blacknight
Default

That's giving a 404 ie. there is no robots.txt file
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Spurl this Post!Reddit! Wong this Post!
Reply With Quote
  #7 (permalink)  
Old 18-06-2006, 05:32 PM
Caz Caz is offline
Frontpage User
 
Join Date: May 2006
Posts: 16
Nominated 0 Times in 0 Posts
TOTW/F/M Award(s): 0
Caz will become famous soon enough
Default

Hi Michelle,

So what I'm typing in is wrong? Do you know what I need to put in? Sorry, I just can't seem to find the answer anywhere within the programme I'm working on and as your probably aware by now I'm not exactly an expert.

Many thanks C.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Spurl this Post!Reddit! Wong this Post!
Reply With Quote
  #8 (permalink)  
Old 18-06-2006, 06:13 PM
blacknight's Avatar
Web Slave
 
Join Date: Jan 2006
Location: Ireland
Posts: 6,022
blacknight is just really niceblacknight is just really niceblacknight is just really niceblacknight is just really nice
Send a message via ICQ to blacknight Send a message via AIM to blacknight Send a message via MSN to blacknight
Default

Caz

Maybe if you told us what you were trying to do exactly we would be able to help you

Michele
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Spurl this Post!Reddit! Wong this Post!
Reply With Quote
  #9 (permalink)  
Old 18-06-2006, 06:37 PM
louie's Avatar
Senior Member
 
Join Date: Jan 2006
Location: Dublin, Ireland
Posts: 1,939
Nominated 0 Times in 0 Posts
TOTW/F/M Award(s): 0
louie has much to be proud oflouie has much to be proud oflouie has much to be proud oflouie has much to be proud oflouie has much to be proud oflouie has much to be proud oflouie has much to be proud oflouie has much to be proud of
Send a message via Yahoo to louie Send a message via Skype™ to louie
Default

robots.txt file should be farely simple.
you tell the robots that follows the rules what directory to spider and which one not.
Also not a very good ideea as you give the secret directories out for the ones that aren't really just visitors.
in the robots.txt file you choose what spiders should index your website and what not.
An example:

User-agent: *Disallow: /secure/Disallow: /images/that tells all robots not to spider the /secure and /images folders.Everything else is ok.a better way of protecting a directory is to have it based on login and valid session.
__________________
:. Web Design & Development Web Design Ireland
:. Search Engines Optimization Search Engines Optimization
:. Directory Submission Directory Submission
:. News & Press Release Ireland GiveItSocks.com
:. Used Cars Ireland, Car Parts & Car Audio Cars For Sale, Car Parts & Accessories
:. I Have 2 Find It Directory SEF Directory
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Spurl this Post!Reddit! Wong this Post!
Reply With Quote
  #10 (permalink)  
Old 18-06-2006, 06:39 PM
richardo's Avatar
Senior Senile Member
 
Join Date: Feb 2006
Location: Co Wicklow
Posts: 395
Nominated 1 Time in 1 Post
TOTW/F/M Award(s): 0
richardo has a spectacular aura about
Send a message via ICQ to richardo
Default

Quote:
ERROR Invalid Line:
<!doc type html public "-//W3C//DTD HTML 4.01 transitional// EN">
Correct me if I'm wrong but shouldn't this be
<!doctype html public "-//W3C//DTD HTML 4.01 transitional// EN"> ??

And, as Michele says, there is no such file as "robots.txt", so it can't be validated. Are you talking about HTML validation?
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Spurl this Post!Reddit! Wong this Post!
Reply With Quote
Reply

Tags
robot, text

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On
Forum Jump

Similar Threads

Thread Thread Starter Forum Replies Last Post
HTML Email or Plain Text? blacknight Email Marketing 14 04-03-2007 07:43 PM
Text / code editors? blacknight Coding Help 9 16-05-2006 09:13 AM
Adsense Text Links blacknight Google Adsense 0 21-04-2006 02:31 AM


All times are GMT +1. The time now is 08:04 AM.


Powered by: vBulletin Version 3.7.3, Copyright ©2000 - 2008, Jelsoft Enterprises Limited.
Hosted in Ireland by Blacknight - Test your ISP |Irish Hosting Directory| Armchair.ie|Logo by Eden Web Design|Avatars by Afterglow |Latest Blog Entries | VPS HostingAd Management by RedTyger

Search Engine Friendly URLs by vBSEO 3.2.0