Закрыт

Web Scrape Application

Hi,

I am seeking a seasoned and savvy WEB SCRAPE GENIUS to build/modify a generic web scrape application!!

I hired another developer to build a .net web scrape application a couple of years ago. Now, I want to make more modifications to the application.

I have prepared a requirements document that explains how the application should work and I have provided pseudo-logic for the overall processing model of the web scrape application.

The goal is to build an application that could model and process 100s or even 1000s of different web scrape jobs using the HTTP / HTTPS model -- not a user simulation / automation model. Key features include --

a. automated login to websites and setting cookies

b. proxy server usage

c. get and post automation

d. multi-threading

e. xml, database, and file/csv file saving options

f. configuration file witih over 25 web scrape logic control settings

g. separate job scheduler to triggering scrape jobs to run

The xml configuration file is tailored to fit the website being scraped.

I would like to retain someone I could work with on an ONGOING basis. A monthly retainer quote would be valuable.

The idea is the spend the first 4 weeks building the application. I would provide the current code base in .NET. However, I am considering converting the entire app to PHP as it is cheaper to host linux/php machines than windows vps machines.

Then we would test and modify the application on several web scrape jobs. Most of my web scrape jobs are millions of rows. So architecture and multi-threading are essential.

Start November 1, 2010

Навыки: PHP, Архитектура ПО, Веб-скрейпинг

О клиенте:
( 77 отзыв(-а, -ов) ) Beverly Hills, United States

ID проекта: #828907

22 фрилансеров(-а) готовы выполнить эту работу в среднем за $1292

buraqtech

Check your PMB for details!!!

$1485 USD за 22 дней(-я)
(89 отзывов(-а))
7.9
srinichal

I look forward to take up and deliver the project

$1200 USD за 30 дней(-я)
(134 отзывов(-а))
7.4
mantislin

Hi sir, please check PM for more details, thanks, kimi.

$1480 USD за 30 дней(-я)
(194 отзывов(-а))
7.0
MAnkita

Hello,Please refer your [login to view URL] you.

$1500 USD за 25 дней(-я)
(64 отзывов(-а))
6.8
dotnetsupercoder

Please Check PM for details.

$1200 USD за 21 дней(-я)
(25 отзывов(-а))
6.2
phpXpertbd

Please see pm. Thanks

$1500 USD за 0 дней(-я)
(30 отзывов(-а))
6.2
agstech123

Hi, please check PMB to know more about our technical expertise and capabilities. Regards, Ricku Lohar

$1050 USD за 20 дней(-я)
(12 отзывов(-а))
6.1
aruhat

Hello Please see PMB. Regards, Chandni

$1500 USD за 10 дней(-я)
(12 отзывов(-а))
5.3
alin22

Hello sir, i have send you a pm.

$1500 USD за 30 дней(-я)
(18 отзывов(-а))
5.1
ankitfrenz

please refer pmb

$1500 USD за 30 дней(-я)
(8 отзывов(-а))
4.9
sasiilaya

please check PM.

$1300 USD за 40 дней(-я)
(10 отзывов(-а))
4.6
sunsriinfosys

Hi, I have over 11.5 years of Experience in software design, development and implementation of various commercial applications in Client/Server environment, Web designing using Photoshop, Flash, Web and ERP ap Больше

$800 USD за 15 дней(-я)
(18 отзывов(-а))
4.4
shreesoftech

Hi, i am experienced in crawlers and bots. please check the pmb. Thanks!

$1200 USD за 10 дней(-я)
(10 отзывов(-а))
4.2
fengyanliang

I can do it in Python, ready.

$1500 USD за 30 дней(-я)
(6 отзывов(-а))
3.2
artpar001

Bid is for Long term Monthly Price. Please Check PM for more Detailed information about me.

$800 USD за 30 дней(-я)
(2 отзывов(-а))
2.7
vbily

Hi, We have experience in building such apps. Interested in long-term relationship

$1200 USD за 30 дней(-я)
(1 отзыв)
0.0
Yashwanth111

As we have well experienced team hope that we can complete this project in time

$1150 USD за 10 дней(-я)
(1 отзыв)
0.0
tiblug

Hi I think I can do this job.I have more than 6 years experience in PHP and frameworks, joomla,wordpress,megento ,CAKEPHP [login to view URL] can show my [login to view URL] you can look my some development [login to view URL] now I Больше

$2000 USD за 50 дней(-я)
(0 отзывов(-а))
0.0
johnsw

I propose writing the app in PHP/mySQL. Let's go though the specs: a. automated login to websites and setting cookies. OK - would need to get settings from the XML ; b. proxy server usage. OK, PHP's curl does Больше

$1500 USD за 21 дней(-я)
(0 отзывов(-а))
0.0
mahi86

Hello sir, I am a web and Window developer with specialities in hi-end design, database and customized application development. We are highly experienced integrating multiple languages, database technologies Больше

$751 USD за 10 дней(-я)
(0 отзывов(-а))
0.0