Scrapping project


I need to scrape data from 70-80 websites which provides the same type of data about the same products. Targeted data types are – links, text and numeric. After scraping I need to rearrange, sorting and recalculate all data before a show to my website. Targeted websites add/change/update their data around 1-2 times per hour. So, I need those scrapers run/scrape automatically 1-2 times per hour.

Similar data found on multiple sites should be overwritten/skip/updated while scraping. Similar numeric data should be overwritten/skip/updated or replaced by higher/lower value while scraping. Some data should be overwritten/skip/updated by early/latest date and time.

There are some custom calculators are present on targeted websites. If those calculators can’t be scraped then those calculators have to be built with collected numeric data.

An admin panel needs to add/modify/delete data manually. Need to start/stop scrapers manually. Need to show the scraping reports. Need to control/modify banners on the website.

If you are only expert in scraping/programming, but not in website design/building you’re also welcome to bid in this project.

I need a website designed to show all these scraped data. The design of my website has to be very different than the targeted websites. Need clean and SEO friendly codes/links with full on-page SEO. Need to add payment API integrated to my website. Need some banners spaces on website and banners should be added to the website automatically after payment is done.

Payment system:

Payments will be made by 2 parts. I’ll create a milestone for scraping jobs. I have a simple website where you can show or test the outputs. Or you can build a simple website to test/show the scraped data.

Once the scraping/arranging/sorting/calculations are done successfully, I’ll create another milestone for the website design/functions.

Both milestones will be released after scraping and the website has done. No milestones will be released until the work is 100% complete. I’ll take 24-72 hours to check everything carefully and the milestone will be released then.

** MOST IMPORTANT: You must have to complete the project on the timeframe which will be discussed before awarding the project to you. Once the timeframe is over, the contract may get canceled and milestone payments will be canceled without any notice.

Thank you for reading the full details.

Квалификация: PHP, Python, Веб-скрейпинг, Дизайн сайтов

Показать больше software testing project online bill payment, data extraction scrapping project, recieve payment asp cart display php page, joomla project component online payment, integrated master page sharepoint, freelance project fee escrow payment, project title vendor payment, project net bill payment system, project online bill payment system, scrapping project, web scrapping project, eclipse spring project hello world, data scrapping project, project shopping website payment gateway, web scrapping project documentation, web scrapping project vsona, project sms web payment, data entry project with advance payment, Bookkeeping -Tax return filling -Project Reporting -Payroll & Payment -Auditing & Consultation -Financial statement an, inbound bpo project with advance payment

О работодателе:
( 145 отзыв(-а, -ов) ) Dhaka, Bangladesh

ID проекта: #18899999

24 фрилансеров(-а) в среднем готовы выполнить эту работу за $418


Dear Sir. I am sure, I would complete your job greatly , because I am WordPress professional who published many websites by Using WordPress themes and plugins. Please check some wordpress works. http://provagamou. Больше

$555 USD за 10 дней(-я)
(250 отзывов(-а))

Greetings, I am an experienced scrapper and have done similar projects in the past. Same can be verified by my profile. Let me allow to assist you. Thanks

$500 USD за 15 дней(-я)
(65 отзывов(-а))

Hello, I have gone through your project in detail, and to better understand your project lets discuss over chat so that we are on the same page and let's start working together. Please have a look to our PORTFOLIO: Больше

$500 USD за 7 дней(-я)
(18 отзывов(-а))

I HAVE TOP SKILLS AS YOU CAN SEE MY PROFILE, I'M READY TO START RIGHT NOW. I have read your job description pretty carefully and I am sure that I can do your job. I promise the high-quality code and deliver it in tim Больше

$555 USD за 10 дней(-я)
(24 отзывов(-а))

Hi There, I'm a 5-star web automation developer and a java expert. I have years of experience and have my own ways to compile database in least consumed time with highest accuracy. Check out my profile, portfolio and Больше

$400 USD за 5 дней(-я)
(127 отзывов(-а))

Dear Hiring Manager, I have carefully gone through your requirements. I am a Certified expert WordPress Designer and developer with great experience in the field you mentioned. I have developed many similar Wordpre Больше

$444 USD за 10 дней(-я)
(18 отзывов(-а))

‌Hi, I have gone through your requirement to scrape lots of websites. I am EXPERT in building scraping tools /scripts. Hence, I can SURELY work on your project. I am having 4 YEARS of EXPERIENCE in developing PHP-PYTHO Больше

$277 USD за 10 дней(-я)
(70 отзывов(-а))

Hello there! I am Alex Mcinteer, and I am lead data architect, senior Java developer, and junior Python developer at Mcinteer Software. My business partner Alexander Jackson is a former Project Manager for Microsoft Se Больше

$555 USD за 10 дней(-я)
(13 отзывов(-а))

Hi there, I have a Team. I can do it. I have done many related projects like this. If you are provide this work, it will help my career also. Give me a chance to do this. Waiting for your precious reply. Thank Больше

$450 USD за 10 дней(-я)
(96 отзывов(-а))

Hi Scarping is one of my strong skills. I can build a script for a website in 5 hours. I like to use node.js and python for scraping. We can make the scheduling for your requirement. As I check your requirement, Больше

$600 USD за 10 дней(-я)
(10 отзывов(-а))

I believe in providing good quality code and services with security. I am a Web Security Researcher & Bug Bounty Hunter at HackerOne, BugCrowd, BountyFactory and many other Independent Bug Bounty Programs Reported Больше

$250 USD за 1 день
(69 отзывов(-а))

Hi, Greetings to you. I'm Professional Web Scraper. I can handle your project. I have a Desktop software(webharvy) to collect data automatically. Here is my software activity: [login to view URL] Больше

$300 USD за 30 дней(-я)
(26 отзывов(-а))

Hi we went through your requirement we have experience in Scrapping projects. we can deliver the project within a 7 days As per your requirements we already have some experience • GURU AGENCY • JKR ENGINEERIN Больше

$250 USD за 7 дней(-я)
(20 отзывов(-а))

Hello. I have gone through your project description and believe this is a terrific job for us to work together. We can meet all the requirements required in your proposal. I have highly experience in graphic and Больше

$940 USD за 4 дней(-я)
(5 отзывов(-а))

I'm a professional engineer with vast experience in IoT, sensors, and software architectures. My background is aerospace engineering with a focus on Systems engineering and I'm a very skilled PCB designer and Firmware/ Больше

$277 USD за 10 дней(-я)
(8 отзывов(-а))

Hi XpressWorks I've checked your job post Scrapping project and I am much interested to assist you on requirement . I'll provide you with the quick turnaround for this work and i can start working on it right away. i Больше

$490 USD за 14 дней(-я)
(13 отзывов(-а))

hi there, able to data scrape from website with expectation . ready start right now. waiting for your replay. thank you, shafayat

$333 USD за 10 дней(-я)
(3 отзывов(-а))

Well i have 4 years of experience as a programmer Having experience on python Modules like scrapy pandas etc

$250 USD за 1 день
(3 отзывов(-а))

hello, I am expert in web scraping and data mining worked on many scraping and data processing projects. I will happily interested to work with you and will surely satisfy you. Skill : # Scrapy, Selenium, Splash # P Больше

$250 USD за 5 дней(-я)
(3 отзывов(-а))

Hi, First, I would like to show you some of my scraping work. [login to view URL] Project details: Used Scrapy and mLab/MongoDB to scrape & store data. Saved data in JSON file for reference Больше

$444 USD за 10 дней(-я)
(0 отзывов(-а))