Web Scrapping for over 24k records
Оплачивается при доставке
I need to do web scraping on a website of the Government of Chile (INAPI). This website allows you to enter an ID and obtain the data of a request. The program must receive a set of files in excel, extract the ID of each request, and update 5 columns of the excel files, according to the information found. It must also generate a sqlite database with all the information obtained in the web scraping for future queries through SQL.
This website does not have validation for Web Scrapers (such as reCAPTCHA or puzzle solution), but it does have a search limit (possibly based on the number of requests from a particular IP).
I also have some TypeScript code that already reads the excel file, does web scraping, and updates the excel file (which I can give you as a reference if needed).
It's important, given the deadline, that you can work with multi-concurrency (in my TypeScript code, I work with Puppeteer-cluster)."
The excel files contain an approximate total of 25k records that need to be searched, and the website limit is approximately 500 records.
ID проекта: #36381237
14 фрилансеров(-а) готовы выполнить эту работу в среднем за $42
I have more than 5 years of experience I can do it very easy. Already I completed so project like this. just close your eyes and trust me. I am sure. you will be happy.