This is a web scraping project.
We are looking to engage the services of an experienced web scraping company or individual, to build repeatable scraping processes for a series of forum sites containing similar content and reviews. The data will need to be landed into a MySQL database, which will eventually be hosted on AWS.
At this stage there are 6 candidate forum sites, however this maybe increased to 10 and flexibility is required add to the quote.
The initial requirement is a one off scrape, however this process must be repeatable and able to be pick up delta changes only, with data update/insert into the database.
The web scraping technology used must be industry standard, easily accessed and understood by the employer. The employer (data architect) is familiar with scraping products, Helium Scraper and FMiner.
The project will commence 1/12/16 and the initial scrape must be concluded by 15/12/16. Project to be concluded by 31/12/16.
This is a proof of concept and there will be many more web scraping opportunities as the business develops, so the successful applicant can expect to be engaged on numerous future projects.
The successful applicant will be required to sign a non-disclosure and intellectual property agreement.
Please indicate your interest and respond with any questions and an initial quote. The shortlisted candidates will be sent a list of 6 forum site URL’s and a specification document outlining the specific attributes to be scraped. A final and accurate quote will then be requested.
Please do not apply unless you are an experienced web scraping professional and can provide real examples to be evaluated.