Scraping and building API -- 2

Our company has an ongoing project that has to do with online sports predictions.

We have a data provider. It proved lacking in some data, and this affects the quality of data we want to provide our clientele; thus, we need to get our hands on more relevant data. We need someone who has a solid experience in web scraping. We are pretty clear on what we want to achieve, where to get and what data we need exactly, but we have hit a snag with our steps, and we need someone to help us. In a nutshell, this job will entail:

1. Setting up a process of pulling data from 2 websites or more using a scraping tool like Octoparse;

2. Putting the data pulled/ output into our database because we need to have that eventually put into the API we are building;

3. Doing the data pulling as a scheduled scraping (websites to be scraped: - OddsPortal and Footystats);

4. Working out inconsistencies (for example, data IDs that vary from one website to another) of the data pulled from different sources into a coherent and organized whole on our database.

This is basically our plan of action but there must be a much better or easier way and we need someone to help us. To give you an idea, we need to scrape these data:

From Footystats / Whoscored / Flashscore (website sources)

- Countries

- Leagues / Historical Season Matches / Historical Season Stats

- Teams / Historical Season Stats

- Players / Historical Season Stats

From OddsPortal

- Historical Odds with Bookmaker

- Future Odds (Scheduled Scraping) with Bookmaker

Please, no timewasters as we have interviewed some candidates before who let us down. So if you think this task/job is something you have done before or you can easily do, please express your seriousness by sending us your CV, a short message about any experience you had about scraping, and how that relates to this job we have posted, and answer this question: When you did that web scraping task/job and you experienced being blocked because of your IP, how did you get around it to finish the job?

Навыки: PHP, Веб-скрейпинг, Архитектура ПО, MySQL, Интеллектуальный анализ данных

О клиенте:
( 0 отзыв(-а, -ов) ) Lisbon, Portugal

ID проекта: #34813159

44 фрилансеров(-а) готовы выполнить эту работу в среднем за €2113


Hi There, Thanks for your valuable time. :-) Please check below points : 1. Our company has an ongoing project that has to do with online sports predictions. We have a data provider. It proved lacking in some data, Больше

€2987 EUR за 50 дней(-я)
(762 отзывов(-а))

Hi. Experienced Web Scraper and API developer here with 6+ years of extensive hands-on experience in Full Stack Web/API Development. I am happy to mention that I rank in the top 2% among 58+ million freelancers. I wa Больше

€3000 EUR за 20 дней(-я)
(73 отзывов(-а))

I am an expert in Scrapping and have been a part of ticket attendant team and have also been a part of a team in developing a Spider application which could crawl any website and the data to be extracted was defined th Больше

€2250 EUR за 7 дней(-я)
(30 отзывов(-а))

Hi. We are building a tool for web crawling and web automation and we implementing different workflows for different website. Right now we scrape like 10M pages per hour and we are happy to work on your workflows as w Больше

€3000 EUR за 7 дней(-я)
(100 отзывов(-а))

hello. i can build your project with my professional skills in Data Mining, MySQL, PHP, Software Architecture, Web Scraping. you will get full satisfy. we can discuss more via chatting. best regards.

€2400 EUR за 36 дней(-я)
(51 отзывов(-а))

Scraping and building API -- 2 Hi, how are you? Can we discuss in detail? I believe I could swiftly surpass your expectations for this role. I look forward to discussing your needs and what I can offer in further det Больше

€1900 EUR за 2 дней(-я)
(42 отзывов(-а))
(77 отзывов(-а))

Hello Client, Hope you are doing great !!! We are Awebon Technologies Pvt. Ltd. an experienced team of Web and Mobile Developers with 10+ years of experience. we have seen your job advertisement Больше

€1501 EUR за 10 дней(-я)
(94 отзывов(-а))

Hello, I have gone through your outsourced requirements " Scraping and building API -- 2 " and have analyzed that I have right skills ( PHP Web Scraping Software Architecture MySQL Data Mining ) to execute your Больше

€2250 EUR за 7 дней(-я)
(124 отзывов(-а))

Hi there, I am full stack developer having strong expertise in web scraping, web monitoring, web automation and b-o-ts. I have already made huge web scrapers and live monitors for bet365, amazon, facebook, ebay with dy Больше

€2350 EUR за 10 дней(-я)
(87 отзывов(-а))

Hi there, I can help you with scraping and building API. I have a lots of experience in this field. Please ping me back so we can discuss further. Looking forward to hearing from you soon. Regards, Pooja Bohra

€1500 EUR за 4 дней(-я)
(97 отзывов(-а))

Hey there, I have 4 years of working experience in web technologies and I have a strong working knowledge of every possible framework which is in the market. In terms of client-end I know: Software Architecture, MySQL Больше

€3000 EUR за 15 дней(-я)
(39 отзывов(-а))
(64 отзывов(-а))

Kindly consider my bid for developing your data scraping software from multiple websites. Comprehensive experience of designing, developing and deploying software applications in area of sports betting, scraping, gambl Больше

€2000 EUR за 35 дней(-я)
(16 отзывов(-а))

Hello dear! I am available right now to discuss the project! I am efficient WordPress Developer and I use WordPress and Adobe Photoshop to craft the designs with skills including Web Scraping, MySQL, PHP, Data Mining a Больше

€1500 EUR за 3 дней(-я)
(51 отзывов(-а))

Good to see you! I am available right now! I have done similar work before, and I can assure you 100 % satisfied job. If you have some questions, you can contact me so we can discuss in detail. ✅ These are some of my Больше

€1500 EUR за 3 дней(-я)
(40 отзывов(-а))

Greetings! I have a lot of experience in data scraping. We have to change the ip client in every request to avoid the problem of IP being blocked. Does the site have a captcha? I create this API. Can you give me more i Больше

€1760 EUR за 5 дней(-я)
(34 отзывов(-а))

Hello, I can develop a powerfull scraper to scrape all the data from Footystats/Whoscored/Flashscore. I have bypassed IP restriction using Proxy API services. Which allows to change IP on every request. All the scraped Больше

€1500 EUR за 7 дней(-я)
(54 отзывов(-а))

For that case, I'll use vpn. Hello, sir! How are you? I am a web scraping specialist. I have rich experience about web scraping. I've been using bs4, selenium or scrapy... I've ever scrapped dozens of sites at once als Больше

€2250 EUR за 7 дней(-я)
(26 отзывов(-а))

✅ Hello, I have a few questions regarding your shared requirement. Please open the chat so we can discuss. I have 10 years of experience in PHP, Wordpress, Codeigniter, Laravel, Python, Django, JavaScript, Shopify, Больше

€2250 EUR за 7 дней(-я)
(24 отзывов(-а))