Automatic searching of Google
This is a discussion on Automatic searching of Google within the Google forums, part of the Search Engine Optimisation category; Hi Guys Im looking for a little advice. I want to do a small project that will download in csv ...
| |||||||
| Register | Forum Rules | FAQ | Donate | Members List | Calendar | Search | Today's Posts | Mark Forums Read |
04-02-2008, 02:53 PM
| |||||
| |||||
 Automatic searching of Google Hi Guys Im looking for a little advice. I want to do a small project that will download in csv the top 10 results in google for a particular search term. However I have approximately 500 search terms, so want to automate this as much as possible. Are there software programmes out there that can do this? I know there is google soap and I do have a key, however its outside my knowledge of programming. All advice greatly appreciated. Thanks Fintan
__________________ Computer Room Cleaning UK|Keyboard Cleaning UK|Suction Cup Lifters UK | Cable Grommets UK | Koldlok UK|Snag Lists Ireland | Interior Design Ireland|Stone Cladding Ireland |Glass Blocks Ireland |DIY Kitchens Ireland         |
|
04-02-2008, 03:51 PM
| |||||
| |||||
| What are your search terms currently in ? excel ? txt file ? paper :P ? How do you want the output ? [I don't specifically know of any program out there ... there are loads probably]
__________________ Forbairt Media | Web Design & Development Galway / Dublin, Ireland - coming soon ... ( vague but descriptive isn't it ) Recent Work: Safari Club African Safari Holidays - Malawi Safaris Other Stuff: FluffyLinkulator Rapid Inclusion Service Tools |
TOTW/F/M Award(s): 1
|
04-02-2008, 04:08 PM
| |||||
| |||||
| Easiest way to do it would be a simple php file that pulls your search terms from a mysql DB googles them and scrapes the top 10 results out and stores them in a second table. Wouldn't take too long to write and would be the easiest for reporting on and storing the info. Edit: run it on a cron every day obviously, to fully automate it.
__________________ PHP Code: |
|
04-02-2008, 04:10 PM
| |||||
| |||||
| I can present the search terms in whatever format is needed thats no big deal. The results I'd like to see are as follows: Search Phrase Position 1 URL Position 2 URL All the way down to 10 I've tried googling but am struggling try to find anything relevant. |
|
04-02-2008, 04:13 PM
| |||||
| |||||
| Quote:
Cheers Fintan |
|
04-02-2008, 04:21 PM
| |||||
| |||||
| I have some code here that'll partially do it for you ... but its rough very rough ... if I get a chance I'll pass it on later if anyone is interested ... Not sure how much google would like getting 500 keyword requests though ... there are probably better ways of doing it as well hmm... |
|
04-02-2008, 04:25 PM
| |||||
| |||||
| I'd appreciate any help, thank Forbairt. Well the api allows 1000 searches per day, so Im not too worried about that. The google soap api does allow automated searches, its just that I don't know enough to set it up to work the way I want. |
|
05-02-2008, 12:46 AM
| |||||
| |||||
| Quote:
__________________ Search Engine Optimisation - Red Cardinal Internet Marketing Internet Consultant Ireland | Search Engine Optimisation Services Catering Company Dublin - My sister's handmade canape company! |
|
05-02-2008, 12:51 AM
| |||||
| |||||
| code was rather simple actually... parsing a page of its links ... a loop could be dumped onto it and you could run it overnight but I won't be going that route ... Took a look at the Search API ... with a small bit of work it should be possible but yeah I'd have to read up on the TOS on it which I haven't done. Being allowed to run 1000 ? queries against the API a day may not mean you're allowed to run an automated query against it ? (though time delays and so on could be implemented...) |
|
05-02-2008, 12:59 AM
| |||||
| |||||
| Automated requests are no problem with API. You can hammer them until you hit 1k, then they tell you to go forth and prosper. Until tomorrow. |
 |
| Tags |
| automatic, google, searching |
| Thread Tools | |
| Display Modes | |
Linear Mode
|
|
| ||||
| Thread | Thread Starter | Forum | Replies | Last Post |
| Crippled version of Google? | Conor O'Nolan | 6 | 06-03-2008 05:52 PM | |
| Successful Site in 12 Months with Google Alone | montyauto | Webmaster Articles | 11 | 18-02-2008 01:28 PM |
| How to Avoid the Google Sandbox | Cormac | Webmaster Articles | 26 | 18-02-2008 05:38 AM |
| Are Google stupid or is it just me? | Cormac | Webmaster Discussion | 4 | 11-05-2007 04:10 PM |
| Google Question on Regional Google & othes? | Gman290 | Search Engine Optimisation | 8 | 10-05-2007 12:13 PM |
| ||||||||
| |  |  | ||||||
All times are GMT +1. The time now is 02:58 AM.
