I need an app that allows me to submit a search query to a search-engine (TBD); retrieve results, and write them into a table.
I need to do this in a transparent manner (relative to the search-engine). Specifically:
App receives a search-query-string then executes it, gets results, parses them and writes corresponding bits into a mysql table. Bits will include organic-urls, ppc-urls, text-snips, related queries (tbs=clue:1), number-results-found, etc. (all these data contained in the SERP)
I need a proxy-type-app to execute queries; that is, I need to use either anonymous proxies or my-own-built-rented proxy. I need to use a different IP every time a search query is executed (dynamic IPs).
Your work is to:
1) propose how to do the hiding-IP part (including what services to rent for any VPS or the like you see is needed; I will rent such services based on your suggestions, I will transfer all passwords to you so you can integrate project).
2) parse SERP to tables (TBD).
3) help me set up all the bits and pieces as needed so I can execute queries from the comfort of my home, get results in my local mysql tables so I can do the work I need (that is, THIS project creates the data I need for the work I want to do).
Ideally I would like to select the IP from which to launch search query, keep this in mind when proposing a IP-VPS-Proxy-ETC rental service. At this stage of this project I would like to control (or have access to) 5 IPs from Canada (e.g., Vancouver, Toronto, Montreal, big cities) and 5-10 IPs from USA (N.Y., Los Angeles, Chicago, Houston, Phoenix, big cities). Nothing fancy from rental services, keep in mind that goal is to hide real user executing queries nothing else.
I would like to have all software needed in PERL but I am open to suggestions if you think something else is better (just say why you think so please).
Feel free to ask for more info if this project description is not enough to put your bid, be specific about what info you need (Hiding/Parsing/Setting-Up); I will transfer a detailed project description to successful bidder.
13 фрилансеров(-а) подали заявки на эту работу; средняя заявка - $541
I can do this work. I have practical experience in search engine technologies. Have a look at my profile. I suggest Python, Apache-Solr & Lucene, BeautifulSoup, MySQL.