[URGENT] Wordpress plugin expert needed [SCRAPER}

I have a wordpress plugin that works by scraping google for domains then checking them to see if they are expired and can be re-registered.

The plugin is fully developed and "works" But I need an expert developer to come in and make it faster, better threading, and better processing of proxies etc.

You need to have good experience in developing scripts and plugins and hopefully scraping type plugins.




The purpose of this plugin is to scrape data from google – we input a search term and google will search the web for websites that include this search term. The plugin will then take all of the search result websites and scrape them for URL’s – external links. The plugin then checks all of the domains it’s scraped to see if they are dead/expired and can be registered.

The plugin does this through a 2 stage process – DNS then Whois checking. It checks to see if the domain is currently hosted somewhere (Very fast) if the website is not being hosted, then the plugin does a whois check (slow) – through this, we can then eliminate the slowness of the whois check by only using it to check a small % of the domains it extracts.

The plugin then displays the domain as AVAILABLE and will show up live in the “Domains found so far” box and also at the end once it’s finished checking – in a downloadable excel format. The plugin supports multithreading so it will be searching/scraping/checking all at the same time and will display live domains as it finds them.

The plugin has been developed to run on Cron jobs – so this plugin can be run on any sized host – shared/dedicated etc. We want this plugin to be able to support very large multithreading without timing out the server etc. Essentially, it should run on multi threads that allow us to search hundreds of keywords and utilize thousands of proxies at the same time




Currently, the plugin seems to have speed issues and it’s not displaying outputs properly.

We need a new proxy checking mechanism – the checker should check all the proxies and start running searches as the proxies come back as LIVE – so we start getting “dead domains” asap, the object of this plugin is to get results as quickly as possible. The checker should run as many threads as there are proxies, ensuring fastest speeds possible.

I asked for a blacklisting functionality to be integrated – when it searches and checks a domain, if the domain is LIVE and can’t be registered, then it goes into a blacklist that ensures that the domain won’t be checked again if it shows up again in another search run. This has been coded in already, but not utilized – please get that working.

That’s all there is to it really, the other functionality is already there – custom search range etc, we just need to establish why it’s not working exactly right, earlier alpha versions of this from my previous developer were working fine, but they just had speed issues.

I need you to go through and get it up to scratch allowing fastest processing possible and ensure it works properly and we will be good to go. So half your job will be debugging then some quick fixing at the end :)

So, can you do this? Price and timeframe?

Квалификация: MySQL, PHP, Веб-скрейпинг, Дизайн сайтов, WordPress

Показать больше wordpress web developer support, wordpress expert support, wordpress expert price, wordpress expert plugin support, wordpress expert jobs, wordpress developer support, why google is better, websites developer on wordpress, website debugging expert, web developer wordpress jobs, web developer wordpress job, web design is dead, searching websites design, searching for a web developer, price of a small wordpress website, need quick web developer, multithreading jobs, live support jobs, live-in jobs, live in jobs

О работодателе:
( 138 отзыв(-а, -ов) ) Lilydale, Australia

ID проекта: #4364930

16 фрилансеров(-а) в среднем готовы выполнить эту работу за $592


Check your PMB for details!!!

$750 USD за 18 дней(-я)
(75 отзывов(-а))

Lets do it

$500 USD за 9 дней(-я)
(128 отзывов(-а))

Hi sir, please check PM, thx Kimi.

$619 USD за 6 дней(-я)
(175 отзывов(-а))

I have all skin to done this for you. Please contact with me and check previous project about scrapper data https://www.freelancer.com/projects/PHP-Data-Entry/scrape-amp-convert-video-sources.html [login to view URL] Больше

$750 USD за 7 дней(-я)
(104 отзывов(-а))

We have more than 5 years of experience in wordpress where we have done lots of theme designs and custom plugins development. We can do your work easily.

$588 USD за 10 дней(-я)
(102 отзывов(-а))

Hi, we have expertise in HTML5 / CSS3 (Mobile Browser Compatible & Responsive), jQuery, PHP/MySQL, .Net, OsCommerce, Wordpress, Joomla, Drupal, Magento, ZenCart, Mobile Apps etc. You can see more details with PMB, Than Больше

$750 USD за 15 дней(-я)
(40 отзывов(-а))

hi, please find the attached private message of the work done ....Thanks!!!

$550 USD за 15 дней(-я)
(61 отзывов(-а))

Hello Please read more than private message thank you

$500 USD за 5 дней(-я)
(45 отзывов(-а))

Hi, I'm the best person for your job! Please, see PMB.

$750 USD за 10 дней(-я)
(7 отзывов(-а))

Ready to Start, Will Try to Give You Our 100% Effort for Your Satisfaction with our Service. Please check your PMB.

$500 USD за 7 дней(-я)
(14 отзывов(-а))

I've read your requirements and I clearly understand the job.I can do [login to view URL] check your PMB.

$600 USD за 10 дней(-я)
(18 отзывов(-а))

ready to start the project. I want to introduce our self, we are a group of freelancers we have 11 year of experience in web application development and design for different domain, please go through the attach Больше

$500 USD за 17 дней(-я)
(10 отзывов(-а))

Hello Sir, We have gone through the details you have provided and would be pleased to work on this with you to deliver the results that you have expected and We are sure you will not be disappointed if you give us Больше

$500 USD за 15 дней(-я)
(11 отзывов(-а))

Ready to start. Thanks

$450 USD за 5 дней(-я)
(16 отзывов(-а))

Dear Sir, Greetings! We are WeExcel Technologies Pvt. Ltd with 10 years of experience under our belt. We are really interested to work on your project. Please see PM. Thank you. Regards, WeExcel.

$500 USD за 10 дней(-я)
(2 отзывов(-а))

I have 3 years experience with the use of php and javascript programming for web applications. I am familiar with developing wordpress plugins and web scraping. It sounds like you need help with parallel processing in Больше

$400 USD за 5 дней(-я)
(5 отзывов(-а))

Hello Sir, We have worked on similar requirements earlier. Please check your PMB for more details. Kind Regards

$825 USD за 12 дней(-я)
(2 отзывов(-а))

Hello Sir/Mam, We ensure the quality as its the key to success. Thank you, Group,

$650 USD за 25 дней(-я)
(1 отзыв)

We are exert in Wordpress. We look forward to work with you! Lets discuss in PM!

$390 USD за 5 дней(-я)
(1 отзыв)

Hi, We are one of the best developer on freelancer. We can provide you an excellent solution as we are professional and experience. We can develop your desire application within timeline. Read my PM for your ulti Больше

$800 USD за 10 дней(-я)
(0 отзывов(-а))