Завершено

data cleanse large data files

I have very large files, CSV, that are too large to be edited in SQL. I am looking for someone to write in Python or some other free ware a script to edit out records that have certain keywords or word fragments. Once editing the keywords, the script will create a new file without the deleted records while maintaining the old file in it's original form.

The files have anywhere from 10 million to 400 million records

Please let me know what technology you intend to use. Once the script is completed, I will want to use it myself. You will only be working on a small data set from my database.

Квалификация: MySQL, Python, Ruby on Rails, SQL, XML

Показать больше data cleansing software free, data cleansing tools in excel, data cleansing techniques, data cleaning tools, data cleansing tools list, data cleansing software, what is data cleaning in data mining, data cleansing examples, I have large PDF files that, extract data from csv files using R, website create retrieve data form, create data form update, create data form, extract data multiple csv files, data extraction csv files database, attaching large files web form, bluehost create data form, create excel csvtext files data feeds websites, create report access 2007 data form, create data form joomla

О работодателе:
( 6 отзыв(-а, -ов) ) dania beach, United States

ID проекта: #15283150

Поручен:

mathurforwork

Hi, I am an expert Web developer with knowledge of databases and python under my belt. I have read your job and see you want to sort information. Relevant Skills and Experience I have 3 years of experience in pyt Больше

$40 USD за 1 день
(2 отзывов(-а))
1.9
rubnogueira

I normally write my scripts with Python. For your case, I will use UnicodeCSV module. Could you provide me one sample? Contact me so we could talk better about the project. Thanks Relevant Skills and Experience Pytho Больше

$50 USD за 3 дней(-я)
(11 отзывов(-а))
4.0

44 фрилансеров(-а) в среднем готовы выполнить эту работу за $135

krunalcp

Hello, I have read your requirement to process large CSV file. We are pretty confident that we can do this job very accurately. Recent work to prove our expertise. [login to view URL] [login to view URL] Больше

$133 USD за 1 день
(41 отзывов(-а))
6.8
gangabass

I can create simple GUI app that will allow you to select CSV file and after you click Start button it will read lines one by one and edit / filter each line just like you want. Relevant Skills and Experience I'm guru Больше

$55 USD за 1 день
(226 отзывов(-а))
6.6
sumon355

Hello, As an experienced developer, i would like to provide a program developed by C#.Net. I need to see a sample file and need to know what/how exactly need to modify into a new file. Thanks Relevant Skills and Expe Больше

$160 USD за 3 дней(-я)
(144 отзывов(-а))
6.8
$155 USD за 3 дней(-я)
(30 отзывов(-а))
6.2
$150 USD за 2 дней(-я)
(75 отзывов(-а))
5.8
furqanorpiv

Hi, I am FURKAN a CERTIFIED MySQL, Python, Ruby on Rails, SQL, XML EXPERT . I would love to provide you Quality Python Script that can edit records and create a new file without the deleted records while maintai Больше

$30 USD за 1 день
(35 отзывов(-а))
5.8
ThanassisKalv

Hi Python tools are more than sufficient for this job, plus is that will make it easier for you to re-use it or even apply modifications. The size of the target files should not be a problem (judging from your objecti Больше

$50 USD за 1 день
(74 отзывов(-а))
5.7
iticus

Hello, I would use Python for this project, reading the file piece by piece as it probably won't fit into memory at once. Relevant Skills and Experience Python,Big Data,CSV,SQL,Linux Proposed Milestones $200 USD - D Больше

$200 USD за 2 дней(-я)
(25 отзывов(-а))
5.5
Vlzinch

Hi,linkedinmarty! I can such script with python, for data manipulation it will use pandas library. Relevant Skills and Experience I work with data processing for last 7 years, and have done dozens of similar scripts. Больше

$242 USD за 2 дней(-я)
(9 отзывов(-а))
5.6
$250 USD за 4 дней(-я)
(21 отзывов(-а))
5.4
synl0rd

Hi I am Hadi, you can check my skills too there. Also can looking in my rating review freelancer.com https://www.freelancer.com/u/synl0rd.html My successful product build with myself: [login to view URL] (Health Track Больше

$277 USD за 10 дней(-я)
(13 отзывов(-а))
5.2
aki003iitr

I am data science professional and have experience in data cleaning as well. The project can be completed in python or pyspark Relevant Skills and Experience More than 4 years on experience in data science and data en Больше

$200 USD за 3 дней(-я)
(15 отзывов(-а))
5.0
$30 USD за 3 дней(-я)
(14 отзывов(-а))
4.7
burhanbvk

This would most likely take me a day to finish, maybe two. I would do this in C++ as a console app, that would be the fastest. Or if you want a desktop interface I can alternatively do it on .NET. Relevant Skills and Больше

$250 USD за 3 дней(-я)
(2 отзывов(-а))
4.7
anilbist79

I have check this requirement,have some query,so need to discuss this,please tell me how we can start the discussion. they have more than 11 year of experience,so we can manage this work. Relevant Skills and Experi Больше

$220 USD за 8 дней(-я)
(3 отзывов(-а))
4.2
bhupen2606

Hi, i have experience in handling large data files. i have read your requirement. i'll use Python script to achieve desired text manipulation that will create new file leaving the old file as-is. Relevant Skills and Больше

$50 USD за 1 день
(23 отзывов(-а))
4.3
veskojl

I'm a data expert from Bulgaria with 9+ years of experience in that field. Relevant Skills and Experience 1. ETL - SSIS, Pentaho Kettle, Talend, Oracle Data Integrator (ODI), Informatica PowerCenter. 2. Databases - My Больше

$250 USD за 5 дней(-я)
(1 отзыв)
3.9
bouslimi1979

Hi, since it's a CSV file, why not a VBA macro to filter based on the typed words ? Expérience et Compétences appropriées Excel/VBA macros Étapes proposées $155 USD - m

$155 USD за 10 дней(-я)
(6 отзывов(-а))
3.6
cababay

Hello, i am a solutions architect. I am expert on Python. I usually develop big data solutions. Reading the big files line by line, i aim to use the memory in a minimum capacity. İlgili Beceriler ve Deneyim python Ön Больше

$150 USD за 3 дней(-я)
(9 отзывов(-а))
2.9
huongth

Hi. I can create auto scripts to scrape websites, auto click, format txt, csv, xls, xlsx, doc, docx, rtf, json, xml, database files as you request. I can start right now Relevant Skills and Experience I am an expert i Больше

$100 USD за 3 дней(-я)
(6 отзывов(-а))
2.3