Hadoop ETL Developer
Charlotte, NC
Hybrid
Contract
$69.5/hr - $78.31/hr
Outstanding long-term contract opportunity! A well-known Financial Services Company is looking for a Hadoop ETL Engineer in Charlotte, NC (Hybrid).
Work with the brightest minds at one of the largest financial institutions in the world. This is long-term contract opportunity that includes a competitive benefit package! Our client has been around for over 150 years and is continuously innovating in today's digital age. If you want to work for a company that is not only a household name, but also truly cares about satisfying customers' financial needs and helping people succeed financially, apply today.
Contract Duration: 12 Months
Required Skills & Experience
What You Will Be Doing
Work with the brightest minds at one of the largest financial institutions in the world. This is long-term contract opportunity that includes a competitive benefit package! Our client has been around for over 150 years and is continuously innovating in today's digital age. If you want to work for a company that is not only a household name, but also truly cares about satisfying customers' financial needs and helping people succeed financially, apply today.
Contract Duration: 12 Months
Required Skills & Experience
- 5+ years of experience of software engineering experience
- 5+ years of experience delivering complex enterprise wide information technology solutions
- 5+ years of experience delivering ETL, data warehouse and data analytics capabilities on big-data architecture such as Hadoop
- 5+ years of Apache Spark design and development experience using Scala, Java, Python or Data Frames with Resilient Distributed Datasets (RDDs), Parquet or ORC file formats
- 6+ years of ETL (Extract, Transform, Load) Programming experience
- 2+ years of Kafka or equivalent experience
- 2+ years of NoSQL DB like Couchbase/MongoDB experience.
- 5+ experience working with complex SQLs and performance tuning
- 3+ years of Agile experience
- 2+ years of reporting experience, analytics experience or a combination of both
- 2+ years of operational risk or credit risk or compliance domain experience
- 2+ years of experience integrating with RESTful API
- 2+ years of experience with CICD tools.
What You Will Be Doing
- Design and implement automated spark-based framework to facilitate data ingestion, transformation and consumption.
- Implement security protocols such as Kerberos Authentication, Encryption of data at rest, data authorization mechanism such as role-based access control using Apache ranger.
- Design and develop automated testing framework to perform data validation.
- Enhance existing spark-based frameworks to overcome tool limitations, and/or to add more features based on consumer expectations.
- Design and build high performing and scalable data pipeline platform using Hadoop, Apache Spark, MongoDB, Kafka and object storage architecture.
- Work with Infrastructure Engineers and System Administrators as appropriate in designing the big-data infrastructure
- Collaborate with application partners, Architects, Data Analysts and Modelers to build scalable and performant data solutions.
- Effectively work in a hybrid environment where legacy ETL and Data Warehouse applications and new big-data applications co-exist
- Work with Infrastructure Engineers and System Administrators as appropriate in designing the big-data infrastructure.
- Support ongoing data management efforts for Development, QA and Production environments
- Provide tool support, help consumers troubleshooting pipeline issues.
- Utilizes a thorough understanding of available technology, tools, and existing designs.
- Leverage knowledge of industry trends to build best in class technology to provide competitive advantage.
You will receive the following benefits:
- Medical Insurance - Four medical plans to choose from for you and your family
- Dental & Orthodontia Benefits
- Vision Benefits
- Health Savings Account (HSA)
- Health and Dependent Care Flexible Spending Accounts
- Voluntary Life Insurance, Long-Term & Short-Term Disability Insurance
- Hospital Indemnity Insurance
- 401(k) including match with pre and post-tax options
- Paid Sick Time Leave
- Legal and Identity Protection Plans
- Pre-tax Commuter Benefit
- 529 College Saver Plan
Motion Recruitment Partners (MRP) is an Equal Opportunity Employer. All applicants must be currently authorized to work on a full-time basis in the country for which they are applying, and no sponsorship is currently available. Employment is subject to the successful completion of a pre-employment screening. Accommodation will be provided in all parts of the hiring process as required under MRP’s Employment Accommodation policy. Applicants need to make their needs known in advance.