I need a web scraper written for the following url:
[url removed, login to view]
All pages will need to be retrieved not just page one.
The data on this site changes and the number of pages will vary, however, we need to scrape data from all available pages.
The output should be a pipe (|) delimited file with the following column mappings:
origin_city --> data located in the "Origin City" column
origin_state --> data located in the "Origin State" column
ship_date --> the first date from the "Target Ship (Range)" column changed to the YYYY-MM-DD
format, the exact time is not needed
destination_city --> data located in the "Dest City" column
destination_state --> data located in the "Dest State" column
receive_date --> leave blank
trailer_type --> add the text "Van" to this column
load_size --> add the text "Full" to this column
weight --> data located in the "Weight" column
length --> Leave blank
width --> leave blank
height --> leave blank
trip_miles --> leave blank
pay_rate --> leave blank
contact_phone --> leave blank
contact_name --> leave blank
tarp_required --> leave blank
comment --> leave blank
load_number --> data in the "Primary Reference" column
commodity --> leave blank
The first line of the output should contain all of the column headers.
Any field that contain no data should be left blank.
Please do not use words like "null" or "blank" in blank columns.
Below is a sample output of the first 5 columns using sample data:
The deliverable will be a Perl .pl file that must run on
Ubuntu Linux and must use Modern::Perl. The Perl .pl file
should be called '[url removed, login to view]' and the output file should be
called '[url removed, login to view]'
It will be scheduled in cron to run unattended every 15 minutes.
Please specify what language/OS/modules you plan to use.
Also, please include the word "raccoon" in your bid so I know that
you read this description.
8 фрилансеров(-а) в среднем готовы выполнить эту работу за $152
okay got it ....this will be done ..i have a great experience in web scraping ......... i will do this job for you ....message me so we can proceed further ..thanks
Racoon Hi there, I m quite interested in your project. Kindly go through my profile to know about my expertise. If awarded, I will use bash. Thanks and regards, Raju Sunar