Big data developer

Big data developer

Project is a business intelligence type of solution dealing with data from different sources: logs, site visitors, CRM lists or purchase history data, etc. An EMR based solution is used to analyze and develop person-based marketing campaigns that can be deployed to any of the media platforms.

Tech stack:

AWS: S3, EC2, Elastic Beanstalk, Aurora RDS, EMR

DB: MySQL (using Aurora DB from AWS)

Hadoop: Spark on top of AWS EMR

ETL: Apache Nifi

correction: AWS: S3, EC2, SQS, Aurora RDS, EMR


Experience as a Data Engineer

Knowledge of database design

Experience in Data warehousing, ETL, Data Quality, batch and stream processing.

Knowledge of Big Data stack - Hadoop, Hive, Spark, Kafka, etc.

Strong knowledge of SQL

Strong knowledge of object-oriented programming and design patterns

Knowledge of Scala, or proficient in a typed or functional language

Knowledge of NoSQL databases

Bachelor or Masters degree in Engineering/Computer Science/Math or related discipline


Experience with Google Cloud, AWS or Azure

Experience with Big Query

Experience with Kubernetes

Experience with Scrum

Experience with BDD

Knowledge of Machine Learning

Квалификация: Интернет-услуги Amazon, Hadoop, Hive, MySQL, Spark

Показать больше big data entry project, i have big data entry project with high budget but i dont accept fake profiles in freelancer need original profiles with origina, big data developer freelance, big data developer technologies, big data developer vs big data analyst, big data developer resume, big data developer vs big data engineer, big data developer jobs, big data developer certification, big data developer course, big data developer salary, big data developer freelancer, big data freelancing project, big data hadoop project ideas, big data developer 11 best freelance, big data analytics project management pdf, big data capstone project ideas, big data developer requirements, big data developer job description, big data developer skills

О работодателе:
( 0 отзыв(-а, -ов) ) St Petersburg, Russian Federation

ID проекта: #19010399

26 фрилансеров(-а) в среднем готовы выполнить эту работу за $39/час


Hi, After reading the description we really believe that this is the project which is perfectly matching with our big data department and we are experienced and confident to make your project a success. Only I will re Больше

$61 USD / час
(12 отзывов(-а))

I must say, what you require for 1 person to have that all with expert hands, would be a miracle. I would, however, say that i have knowledge and expertise of following areas and can learn the other where needed. Больше

$41 USD / час
(12 отзывов(-а))

Dear Client. Here is a senior starter of Big Data Technology. I'd like to improve your business with my ability. Enough successful experiences with OOP, RDBMS, NoSQL, AWS, GCP, Machine Learning, Deep Knowledge abo Больше

$41 USD / час
(15 отзывов(-а))

Everlytics is an Enterprise AI company headquartered in Singapore with an offshore development team in Bangalore, India. We as a team have an exhaustive technical skill set and have delivered a number of projects succe Больше

$33 USD / час
(7 отзывов(-а))

Hello I am working in Bigdata/Hadoop technologies for years. I worked in Hadoop, Mapreduce, Spark (Streaming & MLLib), Kafka, ELK Stack, Cassandra, MongoDB, Postgre. I implemented above using Java Scala and Python. Больше

$40 USD / час
(27 отзывов(-а))

Hello How are you. I have read your job description and it needs full stack technical knowledge. Of course I am familiar to AWS(RDS, EC2, S3 bucket ... ) and have managed server there. Seriously most of tech is not Больше

$41 USD / час
(2 отзывов(-а))

Have 10 years of IT experience with more than 4.5 years of experience in hadoop technologies like hive,pig,spark,sqoop,map reduce and [login to view URL] have very good experience in Java,scala,Python and shell scripting. Wor Больше

$25 USD / час
(12 отзывов(-а))

I have been playing with data all my career I have been using Googles ML kit and Tenserflow these days for ML. I also have knowledge of all the tech stack you have mentioned Kindly message me so that we can discu Больше

$41 USD / час
(4 отзывов(-а))

I saw your posting and thought we might be a good fit. We are a full stack development firm with a wide range of experience in development. Our team is highly capable and have worked with companies including Airbnb, PN Больше

$55 USD / час
(3 отзывов(-а))

Hi sir, I have recently worked on a project in which I used market data and used Neural networks to predict when a person is going to change his mobile set. It is one of my successful projects. I am willing to work mor Больше

$41 USD / час
(3 отзывов(-а))

Hello, how are you today? I would love the opportunity to discuss this project with you. I think I am a good fit for this project because I have all the qualities that you are looking for. Experience is the gol Больше

$41 USD / час
(8 отзывов(-а))

Dear sir, I'm sure that I can complete your project 'Big data developer' as soon as possible. I am senior software developer and always provide fast service. I promise a high quality and punctual work :) Skills: Ama Больше

$41 USD / час
(1 отзыв)

Hi, I have 8 years of experience and working on hadoop, spark, nosql, java, BI tools(tableau, powerbi), cloud(Amazon, Google, Microsoft Azure)... Done end to end data warehouse management projects on aws cloud with ha Больше

$25 USD / час
(3 отзывов(-а))

I am aws certified professional. I can help you with this project . I have done automation extracting the data from google to AWS .

$50 USD / час
(1 отзыв)

Hi there, I’d like to be considered for your job position. I’m a Software Developer with a strong background developing Desktop application. My expertise skills are Java , JSP , Spring , Hibernate , BigData, JavaSc Больше

$30 USD / час
(2 отзывов(-а))

Hello there, This is Tahsinul Alam, CEO of Workspace InfoTech Australia PTY Limited. We have 52 engineers in 14 teams who are serving the world wide client in different ways. Our expertise are given below: Techn Больше

$41 USD / час
(0 отзывов(-а))

Hello, Hope you are doing absolutely great. Instead of writing a Proposal I would like to approach you directly for this job, as we have been working on the AWS for last 3 years. Let's take this forward as it loo Больше

$41 USD / час
(0 отзывов(-а))

Hello, I am a certified Cloudera and Hortonworks professional with 3+ years of experience performing analytics on Hadoop using Hive, Impala with YARN and SPARK. I also have a strong knowledge on SQL, MySQL and a lit Больше

$27 USD / час
(0 отзывов(-а))

Hi, I'm a data analyst. I have knowledge of machine learning and spark. I worked on AI projects and big data problems.

$27 USD / час
(0 отзывов(-а))

My work experience and interaction with the required skill set on day to day basis. Reach out to me for more information

$36 USD / час
(0 отзывов(-а))