This is a discussion on Gomezagent crawling my site within the Search Engine Optimisation forums, part of the Online Marketing category; Hey, I have just been looking over webtrends reports for the past month. A spider by the name of gomezagent ...
| |||||||
| Register | Forum Rules | FAQ | Donate | Members List | Calendar | Search | Today's Posts | Mark Forums Read |
| ||||
| Hey, I have just been looking over webtrends reports for the past month. A spider by the name of gomezagent account for 78% of spider activity. Does anyone know anything about this spider? Is it legit? Also, at what point is a spider searching too much to effect my bandwidth? 78% = 685 visits from 19th May - 28th May |
| |||||
| As far as I know its a performance monitoring tool ... At least from this thread ... did you have a search for it first ? Any ideas about GomezAgent+1.0 ? From the looks of it ... I'd ban it unless it was yourself that signed up to test your site.
__________________ Forbairt Media | Web Design & Development Galway / Dublin, Ireland - coming soon ... ( vague but descriptive isn't it ) Recent Work: Safari Club African Safari Holidays - Malawi Safaris Other Stuff: FluffyLinkulator Rapid Inclusion Service Tools Jumper Stuff: Task Drop's Official Geansai Gorm Website |
| Tags |
| crawling, gomezagent, site |
| Thread Tools | |
| Display Modes | |
|
|
| ||||
| Thread | Thread Starter | Forum | Replies | Last Post |
| google not crawling | johned | 7 | 06-03-2008 05:30 PM | |
| ||||||||
| | ![]() | |||||||