Senior Data Engineer
New York , New York
100% Remote
Full Time
$165k - $185k
Job Description | DOES NOT SUPPORT: C2C OR Sponsorship Our client is a people search engine that utilizes deep web crawlers to aggregate data. Their main goal is to reconnect friends, reunite families, prevent fraud, and their most notable usage of their platform has been connecting adoptees to their biological parents.
They are looking for a Data Engineer to work fully remote on their ‘Data Operations Team,’ and help optimize their platform, data pipelines, data extractions, and data preparations. This will involve working with infrastructure built in AWS, including Spark EMR, S3, and DynamoDB. Additionally, this role is going to help build statistical tools, develop unit & stress tests, and create automation in the orchestrating of ETL pipelines.
As the role grows you will help in the determining of data governance, data quality, data cleansing, and ETL processes. Overall, you will have huge impact for the only data company that serves millions of users directly. They bolster a transparent culture and are promoters of flexibility and work-life balance. Required Skills & Experience
They are looking for a Data Engineer to work fully remote on their ‘Data Operations Team,’ and help optimize their platform, data pipelines, data extractions, and data preparations. This will involve working with infrastructure built in AWS, including Spark EMR, S3, and DynamoDB. Additionally, this role is going to help build statistical tools, develop unit & stress tests, and create automation in the orchestrating of ETL pipelines.
As the role grows you will help in the determining of data governance, data quality, data cleansing, and ETL processes. Overall, you will have huge impact for the only data company that serves millions of users directly. They bolster a transparent culture and are promoters of flexibility and work-life balance. Required Skills & Experience
- 7 yrs. of experience
- 5 yrs. of Python experience
- 5 yrs. of Spark OR PySpark experience
- Airflow
- Strong understanding of DAG
- AWS
- Computer Science Degree (Highly Preferred)
- 12-15% bonus (50% performance; 50% on company performance)
- Stock Options
- Unlimited PTO
- Sign on Bonus
Posted by: Connor Hart