Crawl a Single-Page Application (Scrapy)

1 - Use node.js puppeter or python;

2 - When running the script, it should be taken to 3 or 5 different sites, log in to these sites (we have users and passwords), go to a url internal site and collect a list of products (description and price);

3 - Each product collected must be recorded in a mysql database also containing the date the record was recorded;

4 - We will need very detailed instructions on how to install and run the script in windows or linux environment;

At each execution of the script it must record a new line, regardless of whether the same product exists or not.

Навыки: Python, Node.js, Веб-скрейпинг

Показать больше: single page application php, javascript single page application, jquery single page application, ajax single page application, add google analytics single page application, ajax single page application best practices, job description single page application, ios single page application, single page application net, single page application content management, single page application data database net, android single page application, single page application multi tenant, single page application framework, single page application magento, single page application mvc, how to use node js and python, single page application node js

О работодателе:
( 5 отзыв(-а, -ов) ) Resplendor, Brazil

ID проекта: #31363852



✔️ Senior Expert in Web scraping with Python selenium, BS4 module... ✔️ Hi, Thanks for the opportunity to bid on your project. I read your job description carefully. Also, I am an expert in Python with 5 years of exper Больше

$100 USD за 2 дней(-я)
(1 отзыв)

41 фрилансеров(-а) готовы выполнить эту работу в среднем за $198


I can provide you a Python script that will login to your target sites, parse products and save information into MySQL database. All I need to start is a full list of sites + login credentials for each site. Roman

$240 USD за 3 дней(-я)
(487 отзывов(-а))

I can provide selenium to do the automation if you want Thanks

$300 USD за 7 дней(-я)
(115 отзывов(-а))
(43 отзывов(-а))
(79 отзывов(-а))

hi there, Can you please let me know the websites in question? I can make a PYTHON script to login and scrape data from websites. I have expertise in WEB SCRAPING using PYTHON. I'm available to discuss more details in Больше

$100 USD за 2 дней(-я)
(190 отзывов(-а))

Hi, I am a professional python developer with 3+ years of freelancing software development experience. I have reviewed your requirements and I can create the scraper to fetch product details and saving to the mysql DB Больше

$250 USD за 7 дней(-я)
(27 отзывов(-а))

Hello,how are you? I read your job description carefully and i can do it perfectly. I have much experience for 7+ years in WebScraping Field. I can do your job with php ,crawler,scrapy, BS4, Selenium modules of python. Больше

$140 USD за 1 день
(12 отзывов(-а))

Hi! I've looked into your description and am very interested in it. my github url: [login to view URL] I am an experienced professional python, Scraping, Scrapy Expert for 7+ years with multiple successful Больше

$200 USD за 7 дней(-я)
(4 отзывов(-а))
(26 отзывов(-а))

Hi I will be using Python for the task and push the data to SQL. I can work both on linux and windows environment I will also make the installtion smooth by creating installation scripts (fully automated) with small Больше

$150 USD за 3 дней(-я)
(7 отзывов(-а))

Hi I've excellent expertise in web scrapping and I can develop a crawler which will crawl a Single-Page Application for you, Connect

$100 USD за 2 дней(-я)
(2 отзывов(-а))
(15 отзывов(-а))

-----------------Python Expert-------------- Dear Client As a senior Expert, I have 5+ year rich experiences working with Python I can help you with my experiences perfectly Hope to have a conversation in more details Больше

$140 USD за 7 дней(-я)
(2 отзывов(-а))

Hi, I'm Python Automation Bot Development. I can help you to done the task quickly. Contact me to discuss more. Thank you so much

$250 USD за 4 дней(-я)
(4 отзывов(-а))

Hi!! I can deliver you perfect results using Puppeteer/Playwright in node.js or Scrapy/Selenium in python. I have rich experience in Scraping. For example, I scraped emails and prices on several websites in past proje Больше

$250 USD за 7 дней(-я)
(3 отзывов(-а))

⭐⭐⭐ Puppeteer Master ⭐⭐⭐ Hi, Sir! I have read your requirement and I noticed that I am appropriate to this project. As a skillful web scrapping expert , I have rich experience in Web scraping with PuppeteerSharp in C# Больше

$50 USD за 2 дней(-я)
(4 отзывов(-а))

I am a scrapping expert. I have worked on rich site to grab data For using API of json , save data, etc anyway, I can provide several skills for your project. please message me . let's discuss more.

$140 USD за 1 день
(2 отзывов(-а))

Hello! Thanks for your positing "Crawl a Single-Page Application (Scrapy)" and I checked description carefully As an skilled Full stack&Full time software engineer i have strong experience in Web Scraping, Node.js and Больше

$100 USD за 1 день
(3 отзывов(-а))

Hello. I'm pretty happy to bid on this interesting project. I read your description carefully and I think that I am the developer you are looking for and are suitable for this task. I can deliver perfect result on time Больше

$140 USD за 7 дней(-я)
(1 отзыв)

⭐⭐Hello ⭐⭐ I'm a Senior Python Developer with more than 5 years of experience in web development. I like building scalable and clean backend architecture. I will be happy to create a product for you with Python, Dja Больше

$120 USD за 5 дней(-я)
(1 отзыв)