This site uses cookies. To find out more, see our Cookies Policy

Data Engineer - Software in Chicago, IL at Solution Partners

Date Posted: 11/17/2018

Job Snapshot

  • Employee Type:
  • Location:
    Chicago, IL
  • Job Type:
  • Experience:
    Not Specified
  • Date Posted:

Job Description

As a Software Data Engineer, you will build applications and tooling in support of our client's Data domain. You will help design and build data-oriented applications and services for both internal use and by their productions systems. You will be responsible for extracting data from multiple disparate sources, data cleansing/wrangling, batch processing and streaming of data feeds, and support the data science team in productionalizing models and analytical code. A software engineering background is preferred, with experience building/working with data and an understanding of modern data tools and trends.

Desired Skills:
:Experience building applications and RESTful APIs in production systems (Java or Python)
:ETL Pipeline and tooling experience
:Experience with Big Data/HPC Concepts and Technologies such as Spark, MapReduce, HIVE, Hadoop, or Kafka
:Familiarity with BI Tools such as Looker, Spotfire, or Google Analytics
:Data Storage experience with MySQL, Redshift, Elasticsearch

:Predictive Analytics: Machine Learning, Modeling, or Data Mining
:Platform experience using Unix and AWS (ECS, EMR, S3. Route53)
:Containerization: Docker, Kubernetes
:Data specific tooling and libraries: Jupyter Notebook, Zeppelin, numpy, pandas
:Data oriented languages such as R and Julia
:CI/CD: Jenkins, CircleCI, Travis
:Data serialization such as JSON, avro, parquet