Find Information from Websites

Crawling, Web Scraping and API

I need to hire an experienced software engineer, who can design a script or make an API for price comparison website and collect data for all of the mobile phones including; description, memory size, images, make and model. These can be scraped from the Internet.

I’ll provide a list of websites where you have to extract the prices and tidy it on Excel for price analysing and adding your own prices after seeing the Minimum to Maximum price range. The script or the API will be integrated into a website and prices will be upgraded on a daily basis.

Further, all the data must be categorised, for example; Excel, etc.

Company Name Description Make Model Image Min Price Max Price Memory


Buying and selling categories’ list must be separate.

Note: If you also know how to design an e-commerce website, please let me know. Because I am finding it difficult to find someone how can merge these two different tasks. (web scraping and making an API and designing a website).

1) Crawling, Scraping and APIs; for price comparison from various competitors’ websites (for price analysis, marketing and pricing strategy).

• Tidy data

• D3.JS

• Excel formatted

• Bar charts

• Available sources; [login to view URL], Scraperwiki, Tabula, Google Sheet (IMPORTHTML), etc.

• Additional Sources like, Kimono, etc.

• You could design in; R, Python, Bash, Java or PHP but it is better if designed in R or Python.

2) A full list of mobile phone data including; pictures, descriptions, make and models from all the Brands like Apple, Samsung, HTC, Nokia, Lenovo, Blackberry, Huawei, Sony, etc. This data can be scraped and then categorised.

• Brands logo or name will be shown on the landing page, after clicking on a brand logo all of the available model will appear.

• A simple search bar on the landing page. When a potential client types a name, model or IMEI number, his particular phone will appear. (An API will be provided for this).

3) Data removing feature for removing data from all models and makes.

• An email will be sent to the potential client in which explaining how to remove data from the mobile phone.

This section is for the website design:

Preferred and Important Features:

1) HTML, CSS, JS and Jquery. Additional features and languages are welcome

2) Complete CMS and CRM (Delivery, Postage, Accounts, Inventory management, SEO and Social Media integration, etc.)

3) SEO-friendly and W3C validated

4) Multichannel integration, like EBay, Amazon, Facebook and own website

5) Responsive and Dynamic

6) Complete sitemap, HTML or XML

7) Integration with Social Media like; Facebook, G+, Twitter, LinkedIn, Pinterest, YouTube, etc.

8) Integration with PayPal, and a few other companies

9) Adding Google Analytics and Webmaster on pages

Please Note:

• I personally like the disable/enable command with many features when coding/programming. These features are used for some strategic purposes.

• I will also be providing the sample websites and my own preferred design for better UI and UX Customer Interface, experience (Customer friendly website).

• There are certainly many other features which need to be incorporated into this project. However, those mentioned above are the main features which are the major contributors to this particular project.

Note: please only bid if you think you can complete this project. I had some bad experience in the past. I really do not want to waste my time.

I hope you can perform and cater what you just have read above and give your 100% to complete this project with sheer dedication and professionalism. Good Luck.

Thanks in advance

Квалификация: Ввод данных, Excel, Архитектура ПО, Веб-скрейпинг, Поиск в Интернете

Показать больше websites to find information for an academic essay, cms crm mysql jquery, crawl websites information, php, research, web scraping, web scraping web search, websites information web design, websites information fortune company, websites information, websites dat find jobs, fetch websites information, medical transcription websites information, websites information fortune 500 company, arabic cms crm erp cart, integrated cms crm, websites can find possible husband wife, making websites support multiple languages, jquery gallery cms, information find swing tag label

О работодателе:
( 1 отзыв ) Slough, United Kingdom

ID проекта: #11424477

18 фрилансеров(-а) в среднем готовы выполнить эту работу за $543


Hi. This scraping project sounds quite big. I have developed some techniques using Laravel 5 Framework and my own libraries to scrape all kind of information from different websites. It works perfectly on linux servers Больше

$1200 USD за 40 дней(-я)
(16 отзывов(-а))

Hello there, my name is Daniel and I would love to help you out with this project. I have read your description very careful and I think I have both the skills and the experience to achieve what you are looking for. Fi Больше

$199 USD за 3 дней(-я)
(132 отзывов(-а))

Dear Sir, I'm very much delighted to let you know that i did data scraping with PHP-cURL, PhantomJS, Node.js, Selenium from many sites. I just scraped the data from web site and then wrote the data in mysql database Больше

$400 USD за 5 дней(-я)
(65 отзывов(-а))

Hello, I have understood your stated requirements very well. I propose to complete your project with perfection right on [login to view URL] and use the available description and resources in order to complete this project. Больше

$155 USD за 3 дней(-я)
(21 отзывов(-а))

I want to discuss this project with you further, let me know the best suitable time for you to schedule the meeting, Feel free to message me at any time, i used to be online 14 hrs in a day on this website so probably Больше

$257 USD за 10 дней(-я)
(6 отзывов(-а))

Hello, I understood the initial scope of this project. Although i want to discuss further this job in order to prepare the final concept for this project. After Complete discussion over the call or in chat, i wi Больше

$257 USD за 10 дней(-я)
(15 отзывов(-а))

Hi, We will complete your project with in your time requirement. we have great skills in Android, iPhone, PhoneGap,Cordova, ionic, php, Angular JS,Node JS, Laravel Coddeigniter, Wordpress, Magento , HTML/CSS, Dat Больше

$250 USD за 8 дней(-я)
(13 отзывов(-а))

Hello: Greeting for the day! We have gone through your job post and are very excited about bringing your project on board. We are design and development company and providing outsource services. Our main expertise Больше

$155 USD за 3 дней(-я)
(8 отзывов(-а))
$147 USD за 3 дней(-я)
(19 отзывов(-а))

hi i can help you on this .but your budget seems too low for this kind of project. i am expert python/java developer with more than 6 years experience. also point 3 removal feature is unclear. pls reply for further dis Больше

$5555 USD за 50 дней(-я)
(8 отзывов(-а))

Dear sir I have very interested in your job and can complete as you need PERFECTLY. I'd like to work with you. I am ready to start just now. But i have full experiences of outsourcing and have been developed as Больше

$155 USD за 3 дней(-я)
(8 отзывов(-а))

Hi sir, i have read your description and i am interested in your project. Spare me some time that we can speak about project. Waiting for your positive response

$133 USD за 3 дней(-я)
(5 отзывов(-а))

Hello, As per your post ,I have understood your requirement. We are a team of 20 With an expertise of Dynamic CRM and Sharepoint Architect. We are Microsoft Approved Partners and were recently selected for the Mi Больше

$333 USD за 10 дней(-я)
(1 отзыв)

Dear Sir, I can ensure you to complete your jobs with 100% accurate and on time delivery with professionalism. If you select me for these jobs I can guarantee you that I will be best one to you. If I get this oppor Больше

$150 USD за 3 дней(-я)
(0 отзывов(-а))

Hello madam/sir, I'm Chamindu from Sri Lanka. I have successfully completed MS Office course and I completed software engineer degree with lot of working abilities.. Can handle MS Office 2003,2007,2010,2013 packages Больше

$35 USD за 3 дней(-я)
(0 отзывов(-а))

Hello, I have had a look to your project description and you have mentioned that :- you know how to design an e-commerce website. Yes we have expertise in developing eCommerce website and i am confident that I c Больше

$155 USD за 3 дней(-я)
(0 отзывов(-а))

Hello, I have got your job posting on Data Entry Project. According to your job description you need a fast worker for your data mining and web research. For your kind information I want to let you know that I have be Больше

$77 USD за 3 дней(-я)
(1 отзыв)
$155 USD за 5 дней(-я)
(0 отзывов(-а))