Закрыт

Crawl iTunes API and Insert into ElasticSearch

I currently have a script that parses the iTunes API and puts the data into ElasticSearch and Cassandra databases. It crawls the RSS feeds twice per day. It checks iTunes for new Podcasts every day as well. Here is an example of an RSS feed that it parses.

[login to view URL]

So there are Podcasts which are like audio shows. And then each Podcast has multiple [login to view URL] other words each Podcast has one RSS feed and each RSS feed shows the episodes for that podcast sorted by newest release date first.

The current developer of the script is not very responsive to making changes. So your job is to

1 - There are some parse errors for some of the podcast rss feeds.

2 - We are missing a lot of podcasts from iTunes. We can get some of those from another websites API.

3 - Setup data for each podcast regarding how often they release new episodes. We can determine their frequency by just looking at the RSS feed and storing the frequency in the database. For example for those that have a frequency of once per day or multiple times per day we should crawl every hour of the day. For those that are once per week we should crawl maybe 4 times per day etc...

I will give you the code so you can understand it and also talk with one of my other engineers who knows how it works also.

The code is written in python. You must also show me expertise in elasticsearch

Thank you

Квалификация: Python, node.js, Elasticsearch, Cassandra, Podcasting

Показать больше adwords api insert budget, itunes api plugin develop, flash google map api insert map, crawl twitter api, iphone itunes api, itunes api website, itunes api, itunes api php, itunes api linux, itunes api appstore, crawl itunes, crawl itunes store, crawl itunes app, integrate itunes api website, itunes api wordpress, apple itunes api, affiliation itunes api, wordpress itunes api search

О работодателе:
( 131 отзыв(-а, -ов) ) Thiensville, United States

ID проекта: #20952504

12 фрилансеров(-а) в среднем готовы выполнить эту работу за $363

liveexperts123

Hi there, I have read your project description and i'm confident i can do this project for you perfectly.I still have a few questions. please leave a message on my chat so we can discuss the budget and deadline of the Больше

$400 USD за 3 дней(-я)
(15 отзывов(-а))
5.9
zekovicm

Hi there,I am Web Scraping expert from Bosnia & Herzegovina,Europe. I have carefully gone through with your requirements and I would like to help you with this project ! I can start immediately and finish it within the Больше

$322 USD за 7 дней(-я)
(19 отзывов(-а))
5.9
whiteeagle0001

Hello, How are you? I have read your description in more detail and have much interest in your project. So I think that I can finish your work perfectly as you need.I have many experiences for Node js. If you need to Больше

$400 USD за 7 дней(-я)
(18 отзывов(-а))
4.6
zeke

I have lots of experience writing web automation scripts using scrapy and with elasticsearch too. Available to start immediately and finish as soon as possible. Please contact to discuss details if you are interested. Больше

$250 USD за 7 дней(-я)
(12 отзывов(-а))
4.7
RushService

Feel fee to contact me for Crawl iTunes API and Insert into ElasticSearch .Shoot me message to discuss further more details .We provide the comments,images,videos,demos and live sessions in order to help the clients Больше

$200 USD за 7 дней(-я)
(13 отзывов(-а))
4.3
songhwa2019

Hi there. Thank you for your posting. My name is YK Sun and I am a cloud computing egineer. While working with several companies, I have been familiar with elasticsearch/kibana which can be used as a powerful tool of d Больше

$400 USD за 3 дней(-я)
(9 отзывов(-а))
3.7
blackwhite123

Hello, I am pleasure with your job for Crawl iTunes API and Insert into ElasticSearch. Thank you for the job posting. It’s a pleasure to meet you. I’d really like to work with you on this one if possible! I do have a c Больше

$250 USD за 7 дней(-я)
(2 отзывов(-а))
3.2
umairkaramat24

Hello There. How are you doing? I have read the description, I have great experience doing similar jobs related to these skills Cassandra, Elasticsearch, node.js, Podcasting, Python. Please start the chat so we can hav Больше

$280 USD за 13 дней(-я)
(4 отзывов(-а))
2.5
sharktiger

Good day! I'm a licensed full stack programming developer and designer. I have many experiences in python/Django and python selenium webscraping and python image processing by using python openCV package. I have many Больше

$250 USD за 7 дней(-я)
(0 отзывов(-а))
0.0
jaymaninfotech2

JAYMAN INFOTECH PVT LTD is a contemporary Website design and development company with a focus on user-centered design while helping our clients achieves the desired result. we are a custom software development company Больше

$850 USD за 45 дней(-я)
(0 отзывов(-а))
0.0
henry0823

Dear sir. I am henry. I have enough experiences about the elasticsearch, cassandra and python. I had customized the crawl open source, calling as the tor project. tor project is very similliar as your project. tor p Больше

$400 USD за 7 дней(-я)
(0 отзывов(-а))
0.0
farsatech

Hi! Hope you are doing great. My name is Satyajit an expert in Web design and development. I have come to know that you needed support in your project. I would like to have the opportunity to discuss about the project Больше

$350 USD за 7 дней(-я)
(0 отзывов(-а))
0.0