Lead Data Engineer (Python/Docker/k8s)

An esteemed investment firm based in Chicago is on the lookout for a Lead Data Engineer to join their innovative team in a hybrid capacity. Specializing in fostering growth for businesses across technology, healthcare, and consumer sectors, this company is renowned for its strategic approach to investment and operational support. With a focus on driving market success and maximizing value for portfolio companies, they are seeking a skilled Senior Data Engineer to contribute to their data-driven strategies and drive innovation forward. This role presents an exciting opportunity to collaborate with visionary entrepreneurs and make a significant impact in the world of investment.

As a Lead Data Engineer, you will play a pivotal role in creating, designing, and deploying ETL and ELT flows for consuming data from disparate sources of 3rd party data. Your responsibilities will also include building tooling to monitor data pipelines, performing troubleshooting and debugging to identify and resolve data quality and performance issues, and collaborating with data scientists, analysts, and other stakeholders to understand their data requirements and translate them into technical specification. Additionally, you will collaborate with software and data engineers to help build a highly valuable software product and work closely with ML Engineers to deploy, monitor, and maintain ML models in production environments. Your leadership will be instrumental in integrating ML workflows with CI/CD pipelines, ensuring consistent and seamless model versioning, testing, and rollout.

Required Skills & Experience:

• 5+ years of professional data experience
• Proficiency in Python
• Experience Dockerizing containers and working with Kubernetes
• Experience with Prefect or Airflow
• Data warehousing experience, preferably with BigQuery, Snowflake or Postgres
• B.S. in Computer Science or related field

Desired Skills & Experience:

• Cloud experience, preferably with GCP

Applicants must be currently authorized to work in the United States on a full-time basis now and in the future.

#LI-GF1