I need a web scraper written for the following url:
[login to view URL]
To get to the needed information you will have to change “Days from today to view” under the “State Search” column from “3 Days” to “ALL” and then click “Search”. All information needed will be available on that next page. The number of rows will vary.
The output should be a pipe (|) delimited file with the following column mappings:
origin_city --> data located in the "Ship City" column
origin_state --> data located in the "Ship State" column
ship_date --> the date from the "Ship Date” column changed to the YYYY-MM-DD format, exact time is not needed
destination_city --> data located in the "Destination City" column
destination_state --> data located in the "Destination State" column
receive_date --> leave blank
trailer_type --> the data located in the "Trailer Type" column
load_size --> put the text "Full"
weight --> leave blank
length --> leave blank
width --> leave blank
height --> leave blank
trip_miles --> data in the "Miles" column
pay_rate --> data in the “Payment” column
contact_phone --> data in “Phone” column
contact_name --> data in the “Contact” column
tarp_required --> leave blank
comment --> leave blank
load_number --> data in the "Order" column
commodity --> leave blank
There are additional details if you double click on one of the rows but that information will not be needed
The first line of the output should contain all of the column headers.
Any field that contain no data should be left blank.
Please do not use words like "null" or "blank" in blank columns.
Below is a sample output of the first 5 columns using sample data:
The deliverable will be a Perl .pl file that must run on
Ubuntu Linux and must use Modern::Perl. The Perl .pl file
should be called '[login to view URL]' and the output file should be
called '[login to view URL]'
It will be scheduled in cron to run unattended every 15 minutes.
Please specific what language/OS/modules you plan to use.
Also, please include the word "raccoon" in your bid so I know that you read this description.