Завершено

Updated web spider scraping program written for the following username NSS4225

I need a web scraper written for the .xlsx file in the following directory:

[login to view URL]

The latest .xlsx file within that directory will need to be downloaded. The name of the file is subject to change daily and will need to be identified by the latest .xlsx extension.

All information needed is available on the main page. The number of rows will vary. If there is a row without an origin city, skip that row. Data will be listed in blocks with

different contact information for each block, contact information will be located above the block of data.

The output should be a pipe (|) delimited file with the following column mappings:

origin_city --> data located in the "Load Origin" column before the ,

origin_state --> data located in the "Load Origin" column after the ,

ship_date --> data located in the "Date" column, change to the YYYY-MM-DD format,

if the date column is blank or has multiple date use the current days date, also in the YYYY-MM-DD format

destination_city --> data located in the "Destination" column before the ,

destination_state --> data located in the "Destination" column after the ,

receive_date --> leave blank

trailer_type --> data is the abbreviation located in the "Type" column

load_size --> add the text "Full"

weight --> leave blank

length --> leave blank

width --> leave blank

height --> leave blank

trip_miles --> data located in the "Miles" column

pay_rate --> data located in the "Rate" column

contact_phone --> data located in the contact cell above each block of loads (ie: PH (812-823-4212)

contact_name --> data located in the contact cell above each block of loads, the contact name will be listed after the word contact

tarp_required --> leave blank

comment --> data located in the "Quantity/Notes" column

load_number --> leave blank

commodity --> leave blank

The first line of the output should contain all of the column headers.

Any field that contains no data should be left blank.

Please do not use words like "null" or "blank" in blank columns.

Below is a sample output of the first 5 columns using sample data:

origin_city|origin_state|ship_date|destination_city|destination_state|

chicago|IL|2017-03-15|new york|NY|

kansas city|MO|2017-03-15|houston|TX|

The deliverable will be a Perl .pl file that must run on

Ubuntu Linux and must use Modern::Perl. The Perl .pl file

should be called '[login to view URL]' and the output file should be

called '[login to view URL]'

It will be scheduled in cron to run unattended every 15 minutes.

Please specific what language/OS/modules you plan to use.

Also, please include the word "raccoon" in your bid so I know that

you read this description.

Квалификация: Linux, Perl, Веб-скрейпинг

Показать больше write web spider, web spider development, web spider source, web spider crawling website robot vbnet, web spider collect data, email scraping program, build program written, web spider free mysql, web spider source code, source linux web spider, web spider lua, pay visual basic program written, java web widget maker program, contact spider lead program, web scraping program, web spider simplyhired, web spider bot, daily updated web scraping

О работодателе:
( 64 отзыв(-а, -ов) ) Chillicothe, United States

ID проекта: #19509231

Поручен:

gangabass

I can provide you a Perl scraper that will use WWW::Mechanize and other modules. As a result of my work you'll receive same Perl scraping code as before.

$88 USD за 1 день
(451 отзывов(-а))
7.3

13 фрилансеров(-а) в среднем готовы выполнить эту работу за $125

zekovicm

raccoon Hi there,I am Web Scraping expert from Bosnia & Herzegovina,Europe. I have carefully gone through with your requirements and I would like to help you with this project ! I can start immediately and finish it w Больше

$220 USD за 5 дней(-я)
(85 отзывов(-а))
7.1
thinkitltd4

Read your description. I have understand all, i can do this perfectly. message me i able to start now. thanks ...........:)

$100 USD за 7 дней(-я)
(47 отзывов(-а))
6.0
brianconey

Hello How are you My name is Xu i have full time and I can start to work immediately Please contact me and do let us discuss about your project Thanks for your posting

$200 USD за 7 дней(-я)
(27 отзывов(-а))
5.7
schoudhary1553

Hello, I have gone through your job posting and become very much interested to work with you. I am an expert in this field. I have already completed several projects like this. For evidence you can see my profile. Больше

$250 USD за 5 дней(-я)
(19 отзывов(-а))
5.9
smsaurabhv

‌Hi, I have gone through your requirement to scrape lots of websites. I am EXPERT in building scraping tools /scripts. Hence, I can SURELY work on your project. I am having 4 YEARS of EXPERIENCE in developing PHP-PYTHO Больше

$66 USD за 3 дней(-я)
(44 отзывов(-а))
4.9
kkc1985612

Hi, I looked at your description carefully and I am very interested in providing my skills in hopes of working with you. I have ample experience in web scraping. -scrap any website using selenium, beautifulSoup, reques Больше

$150 USD за 2 дней(-я)
(8 отзывов(-а))
4.1
phpizephing

raccoon Hi, I have 7years of development experience using php. I have created many cli script that can be run via cron or manually from terminal. I can do this xlxs -> [login to view URL] I dont Больше

$50 USD за 0 дней(-я)
(5 отзывов(-а))
3.8
urgentprogrammer

Hello: Do I have to use Perl? Can you upload the XLS to S3, and I just make a Kafka script? Let me know please.

$30 USD за 1 день
(4 отзывов(-а))
3.0
annakuzmenko917

Hello, Dear. I have read carefully your requirements. I have the best skills and much experiences in building automation tools for scraping in Python & NodeJs. I have already completed so many projects so far. Now I ha Больше

$100 USD за 7 дней(-я)
(2 отзывов(-а))
1.8
anshsparkle

CONTENT=HELLO I CAN START RIGHT NOW - I AM EXPERT IN and I BET YOU CANNOT FIND BETTER FREELANCER THAN ME ... pLEASE MESSEGE ME AND LETS DISCUSS THE THINGS THANKSPlease Reply

$140 USD за 7 дней(-я)
(1 отзыв)
0.4
writingapp

raccoon. Hi. Great app writer for your projects. I have writen scraping app for many years. I am ready to write your project. Thank you for visiting my profile

$100 USD за 3 дней(-я)
(0 отзывов(-а))
0.0
VishalAgrawal11

Hi,I have read your requirements of Updated web spider scraping program written for the following username NSS4225 and I’m pretty confident that I will be able to get your work done within the given time your requireme Больше

$130 USD за 7 дней(-я)
(0 отзывов(-а))
0.0