Looking for an Experienced Software Engineer, Data Platform

Looking for an experienced Software Engineer for a long-term project, 6 months +. This contract includes multiple sub-projects. Must be experienced in Python, Linux and Bash scripting, Docker & AWS. Experience or desire and ability to learn Apache Spark, Airflow, Snowflake, and dbt is highly desirable.

Some of the projects you'll be working on in order of priority, include but not limited to

Automate dbt docs generation.

Airflow is used to schedule dbt job runs. After each run will need to generate dbt docs and host a static site on s3

We’d also need to use Route 53 to create a DNS

Build a command-line tool to launch spark jobs, both python and java/scala.

Create build files - jars/zip/egg/pip - for CI/CD deployment and productionizing of Spark jobs

These are some of the initial projects you'd be working on, with more to come in the future.

Although I have a preference for someone who'll be available during US Central time zone I'm open to any time zone as long as you're very very responsive in communicating. We'll be using Slack for any and all conversations.

If you are interested in this project, please reply with your prior experience.

Навыки: DevOps

О клиенте:
( 0 отзыв(-а, -ов) ) Dnipro, Ukraine

ID проекта: #33709661

7 фрилансеров(-а) готовы выполнить эту работу в среднем за $184/час


Hi I am DevOps engineer I have experience with AWS, Docker, Kubernetes, Terraform/IAC, CI/CD and others DevOps tools and I am willing to learn according to company needs please contact me for discussion Thank you

$35 USD / час
(2 отзывов(-а))

Hello, I have 11 plus years of experience and worked in projects of python development, AWS involving CI/CD. I have experience in scheduling jobs using Jenkins and wrote scripts in bash scripting as well. I also have w Больше

$20 USD / час
(0 отзывов(-а))

Hello Dear Client, after thoroughly reading your PROJECT DESCRIPTION i have clearly understood it and i would like to work with you. I am Certified PHD holder in SOFTWARE ENGINEERING and DEVELOPMENT. I am a skilled and Больше

$1125 USD / час
(0 отзывов(-а))

A Professional having 2.10+ years of IT experience software industry in DevOps and AWS Cloud using various CI/CD tools such as GIT, JENKINS, ANSIBLE, DOCKER and AWS Cloud Services • Hands on experience on AWS services Больше

$20 USD / час
(0 отзывов(-а))

Hi I have been working in the industry for more than 11 years now and have been providing solutions to different clients in the domain related to Devops, Cloud, Infrastructure, Automation. I have worked on the above m Больше

$40 USD / час
(0 отзывов(-а))

Hi, It is easy, I can do on time. I work online, where you can track progress of your project. I have 6 years of experience in development(websites, web applications, mobile apps, desktop applications, I/UX), using PHP Больше

$20 USD / час
(0 отзывов(-а))

Hi I am Bigdata engineer and I am having rich experience in data pipelines and data processing on Hadoop,Azure and AWS using pyspark and java I can build a simple script for your requirements and we can make a great pi Больше

$30 USD / час
(0 отзывов(-а))