AWS , Google Cloud, Azure Expert please help. (100$) -- 4

Hello. thank you for having interest in this topic.

*Please read description first thoroughly, if you're copy-pasting meaningless words I will instantly dump the proposal. Thank you *

If you have experience in scraping/cralwing work, You know there's a capacity which one scraper one thread can be running.

And in order to compensate this problem , we often adopt multi-threaded system inside of the script, But even when adopting this, We could be still having the same problem.

This is why most of crawlers end up with using Cloud computer/servers , setting multiple virtual computer(server,cloud), setting multi-threaded script inside.

Not necessarily to explain long about this, If you have experience, You'd definitely understand what I'm saying.

I'm here to find decent future co-worker who has related skills to setup such environment and have experience to setup and build such models.

Project price 100$ is related with the right next project we're going to jump on, that I will inform you through DM. (Direct message) or sending official offer.

but beforehand, let me ask you questions.

1) Do you have experience multiple server/cloud/VM based scraping work?

2) If you have answers yes to 1), Could you show me a simple demonstration video about how it gets to be run? (No need to show script or inside-tricks, just on surface, simply the scenes that should be enough to prove it's working)

3) Did you also have experience with proxy-rotation adoptation?

Please fill in the form with sending proposal. If our communication is not in exact form, We can not proceed any further. and I will kindly reject it all once it's not in the question form. Thank you.

Навыки: Aws Lambda, Azure, Облачные вычисления, Google Cloud Platform, SQL-сервер Microsoft

Показать больше: google adwords expert help, google expert help, migrate from aws to google cloud, migrate from azure to google cloud, google cloud vs aws, google cloud for aws professional, google cloud azure equivalent, aws vs google cloud pricing, aws vs azure vs google cloud comparison, cloud dataflow azure, google cloud ec2 equivalent, compare aws google cloud, migrating from aws to google cloud, google cloud expert programme, google cloud vs aws 2018, google cloud platform vs aws vs azure, aws vs google cloud, google cloud vs aws pricing, google cloud vs aws reddit, google cloud vs aws performance

О работодателе:
( 13 отзыв(-а, -ов) ) Incheon, Korea, Republic of

ID проекта: #20328456

2 фрилансеров(-а) готовы выполнить эту работу в среднем за $120


1) Do you have experience multiple server/cloud/VM based scraping work? - Yes. I'm a certified Google Cloud Engineer having experience with web scraping (BeautifulSoup, Scrappy, Selenium in Python) and cloud orchestr Больше

$100 USD за 10 дней(-я)
(0 отзывов(-а))

Hello All, I like the requirement, I used to work such development before. I used to work with one product with multi-thread concept (HPC) with Clustering (Head Node and compute node) on on Premise Windows environment Больше

$140 USD за 7 дней(-я)
(0 отзывов(-а))