So essentially, I want to scrape URL's from the websites that appear for whatever I'm searching.
I need a tool that can work in the following way:
I input a search term "phones" - or whatever other search term ... inurl:phones etc
The tool searches google normally, and then loads the search results that appear
The tool then views the source of each page result and grabs the URL's from each page.
So essentially, I want the tool to search google, load the pages that appear in the search results and then scrape ALL the url's from those pages.
The tool should be able to search say 100 + pages etc.
Tell me about what you have available :) - PMB