Senior Data Engineer
North Chicago, Illinois
Hybrid
Full Time
$140k - $160k
Job Description Are you looking to power data-driven insights to make an impact on the lives of people and patients? The Senior Data Engineer will be leading and designing technical components that will be a crucial step in accelerating and improving accuracy of decision making and therapies for patients. You will be using core AWS services such as Glue, Redshift, or Athena, Python, Spark, and Airflow to unlock information that will contribute to creation of cures for patients, research on pharmaceutical drugs and their applications, ultimately fostering success across your team and those you interact with.
Situated in North Chicago, you’ll enjoy a hybrid schedule, allowing you to find a great balance between guiding junior team members for success, while also having the ability to collaborate with brilliant minds from all over the globe. In this role, you are a key component in becoming an everlasting mark on the world of healthcare. Required Skills & Experience
Situated in North Chicago, you’ll enjoy a hybrid schedule, allowing you to find a great balance between guiding junior team members for success, while also having the ability to collaborate with brilliant minds from all over the globe. In this role, you are a key component in becoming an everlasting mark on the world of healthcare. Required Skills & Experience
Situated in North Chicago, you’ll enjoy a hybrid schedule, allowing you to find a great balance between guiding junior team members for success, while also having the ability to collaborate with brilliant minds from all over the globe. In this role, you are a key component in becoming an everlasting mark on the world of healthcare. Required Skills & Experience
- Bachelor’s Degree with 7+ years of experience; Master’s Degree with 6+ years of experience; PhD with 2+ years of experience in application program development.
- Extensive AWS development experience with core AWS services like EC2, Glue, Spark, S3, Redshift, Athena, etc.
- Relational and non-relational database from a data domain perspective.
- Logging tools like Elasticsearch, Splunk, AWS CloudWatch
- Hands-on technical proficiency in Python, SQL, NoSQL
- Experience building data engineering pipelines using popular tools like Apache Airflow, Glue ETL, etc.
- Experience with logging tools like Splunk, Elasticsearch, AWS CloudWatch
- Able to debug technical issues with existing cloud components.
- Hands-on CI/CD and containerization knowledge and experience (Jenkins preferred).
- Experience with development of API architecture preferred.
- Experience with Cloudera Data Platform (CDP) preferred.
- Exposure to Metadata management, data quality, master data, and data linage a plus
- Exposure to Cloudera CDP, preferably in an AWS cloud environment a plus
- Experience with Knowledge Graphs and Graph Databases a plus
- 50% AWS Cloud Infrastructure
- 20% Python
- 15% Spark
- 15% Airflow
- 60% Hands-On
- 30% Team Collaboration
- 10% Management Duties
Situated in North Chicago, you’ll enjoy a hybrid schedule, allowing you to find a great balance between guiding junior team members for success, while also having the ability to collaborate with brilliant minds from all over the globe. In this role, you are a key component in becoming an everlasting mark on the world of healthcare. Required Skills & Experience
- Bachelor’s Degree with 7+ years of experience; Master’s Degree with 6+ years of experience; PhD with 2+ years of experience in application program development.
- Extensive AWS development experience with core AWS services like EC2, Glue, Spark, S3, Redshift, Athena, etc.
- Relational and non-relational database from a data domain perspective.
- Logging tools like Elasticsearch, Splunk, AWS CloudWatch
- Hands-on technical proficiency in Python, SQL, NoSQL
- Experience building data engineering pipelines using popular tools like Apache Airflow, Glue ETL, etc.
- Experience with logging tools like Splunk, Elasticsearch, AWS CloudWatch
- Able to debug technical issues with existing cloud components.
- Hands-on CI/CD and containerization knowledge and experience (Jenkins preferred).
- Experience with development of API architecture preferred.
- Experience with Cloudera Data Platform (CDP) preferred.
- Exposure to Metadata management, data quality, master data, and data linage a plus
- Exposure to Cloudera CDP, preferably in an AWS cloud environment a plus
- Experience with Knowledge Graphs and Graph Databases a plus
- 50% AWS Cloud Infrastructure
- 20% Python
- 15% Spark
- 15% Airflow
- 60% Hands-On
- 30% Team Collaboration
- 10% Management Duties
Posted by: CJ Avino