Staff Engineer / Databricks / Python / Terraform / AWS
Lake Forest, IL
Open to Remote
Direct Hire
$150k - $180k
We are looking for a Senior Data Engineer to join one of the 100 Best Companies to Work For, with offices in the Chicago suburbs and heart of the city. This team is the Data Engineering Center of Excellence building tools, services, and frameworks that enable other Data Engineering teams across the organization to do their job more effectively.
As a Senior Data Engineer, you will help the team by building reliable and scalable real-time analytics platforms across multiple domains to impact the organizations morst important needs.
Required Skills & Experience
Applicants must be currently authorized to work in the US on a full-time basis now and in the future.
#LI-EM1
As a Senior Data Engineer, you will help the team by building reliable and scalable real-time analytics platforms across multiple domains to impact the organizations morst important needs.
Required Skills & Experience
- As the technical lead and architect, your primary responsibility will be to design and implement highly efficient, reusable, and scalable data processing systems and pipelines in Databricks and Snowflake.
- Design and implement technical solutions and processes to ensure data reliability and accuracy.
- Develop data models and mappings and build new data assets required by users. Perform exploratory data analysis on existing products and datasets.
- Educate data engineering teams in adopting new data patterns and tools.
- Function as SME within this area when engaging with our AI, Platform, and Business Analytics teams to build useful pipelines and data assets.
- 5+ years of experience using Python and Spark to build ETL and ELT pipelines.
- Orchestrating workflows using Airflow, Databricks, Docker, and Kubernetes
- Experience building fully-automated deployment and orchestration pipelines using Docker and Kubernetes.
- Familiarity with AWS Services not limited to Glue, Athena, Lambda, S3, and DynamoDB
- Performance Bonus eligible
- Medical, dental, vision, and life insurance plans
- Paid time off (PTO) and 6 company holidays per year
- Automatic 6% 401(k) company contribution each pay period
- Employee discounts, parental leave, 3:1 match on donations and tuition reimbursement
- A comprehensive set of emotional, financial, physical and social wellbeing programs
Applicants must be currently authorized to work in the US on a full-time basis now and in the future.
#LI-EM1