This site uses cookies. To find out more, see our Cookies Policy

Data Engineer - Platform in Chicago, IL at Solution Partners

Date Posted: 2/17/2019

Job Snapshot

  • Employee Type:
  • Location:
    Chicago, IL
  • Job Type:
  • Experience:
    Not Specified
  • Date Posted:

Job Description

As a Platform Data Engineer, you will ensure the stability and scalability of the Data infrastructure. You will help design, build, and automate build/deployment pipelines, provide data monitoring and metrics for applications and infrastructure in the Data domain, containerize applications, and help plan and execute new data systems. A good candidate will possess a fundamental understanding of distributed systems, the desire to support data scientists and external business units, and a passion to build tools that improve the efficacy of our data operations. A DevOps/Platform background is preferred, with experience building data systems and working with modern data tools.

Desired Skills:
:A proven career working within a Linux operating system
:Experience in system programing (Bash, Python)
:Experience in a SRE/DevOps capacity using an AWS environment leveraging offerings such as: VPC, EC2, ECS, S3, Redshift, RDS
:Experience with containerization such as Docker
:Experience with Configuration as Code tools such as Ansible, Terraform etc.
:Experience with continuous integration, testing, and deployment using tools such as Git or Jenkins

:ETL Pipeline and tooling experience
:Data Storage experience with MySQL, Redshift, Elasticsearch
:Proficiency with Big Data/HPC Technologies such as Spark, MapReduce, MPI, HIVE, Hadoop, Kafka, Cassandra