Looking for a talented programmer to build a website crawler that will periodically (every hour) scrape the entire site and count how many times specific words or strings of words are found on said site.
I essentially want to be able to answer this question:
What is the change in count of the word "Detroit" on Reddit in the:
- Past Month: +0.2%
- Past week: +1.2%
- Past 3 days: +2.2%
- Past 2 days: +7.1%
- Past 24 hours: +9.3%
- Past 12 hours: +15.4%
- Past 6 hours: +23.1%
- Past 3 hours: +78.9%
- Past 2 hours: +381.3%
- Past 1 hour: +1,352.6%
The deduction would be that something may have happened in the city of Detroit in the last 3-6 hours that has sparked online discussion.
I understand that data would need to be recorded to go further back in time. IE, I would not be able to get change in the last 2 hours without first running the program for at least 2 hours. This information will not appear instantly.
I need to be able to search/count up to 10 words at in tandem. And be able to key in the words so that I can change them at any time. Prefer reports to be viewed in excel.
18 фрилансеров(-а) готовы выполнить эту работу в среднем за $22/час
Hello, I can make you a scraper using PHP and simple_xml_dom. I will provide you an admin panel where you can download your reports, change your keywords etc.. Feel free to contact me on chat for more details. Thanks.