Hadoop ETL Developer

Outstanding long-term contract opportunity! A well-known Financial Services Company is looking for a Hadoop ETL Engineer in Charlotte, NC (Hybrid).

Work with the brightest minds at one of the largest financial institutions in the world. This is long-term contract opportunity that includes a competitive benefit package! Our client has been around for over 150 years and is continuously innovating in today's digital age. If you want to work for a company that is not only a household name, but also truly cares about satisfying customers' financial needs and helping people succeed financially, apply today.

Contract Duration: 12 Months

Required Skills & Experience

• 5+ years of experience of software engineering experience
• 5+ years of experience delivering complex enterprise wide information technology solutions
• 5+ years of experience delivering ETL, data warehouse and data analytics capabilities on big-data architecture such as Hadoop
• 5+ years of Apache Spark design and development experience using Scala, Java, Python or Data Frames with Resilient Distributed Datasets (RDDs), Parquet or ORC file formats
• 6+ years of ETL (Extract, Transform, Load) Programming experience
• 2+ years of Kafka or equivalent experience
• 2+ years of NoSQL DB like Couchbase/MongoDB experience.
• 5+ experience working with complex SQLs and performance tuning

Desired Skills & Experience

• 3+ years of Agile experience
• 2+ years of reporting experience, analytics experience or a combination of both
• 2+ years of operational risk or credit risk or compliance domain experience
• 2+ years of experience integrating with RESTful API
• 2+ years of experience with CICD tools.

What You Will Be Doing

• Design and implement automated spark-based framework to facilitate data ingestion, transformation and consumption.
• Implement security protocols such as Kerberos Authentication, Encryption of data at rest, data authorization mechanism such as role-based access control using Apache ranger.
• Design and develop automated testing framework to perform data validation.
• Enhance existing spark-based frameworks to overcome tool limitations, and/or to add more features based on consumer expectations.
• Design and build high performing and scalable data pipeline platform using Hadoop, Apache Spark, MongoDB, Kafka and object storage architecture.
• Work with Infrastructure Engineers and System Administrators as appropriate in designing the big-data infrastructure
• Collaborate with application partners, Architects, Data Analysts and Modelers to build scalable and performant data solutions.
• Effectively work in a hybrid environment where legacy ETL and Data Warehouse applications and new big-data applications co-exist
• Work with Infrastructure Engineers and System Administrators as appropriate in designing the big-data infrastructure.
• Support ongoing data management efforts for Development, QA and Production environments
• Provide tool support, help consumers troubleshooting pipeline issues.
• Utilizes a thorough understanding of available technology, tools, and existing designs.
• Leverage knowledge of industry trends to build best in class technology to provide competitive advantage.

You will receive the following benefits:

• Medical Insurance - Four medical plans to choose from for you and your family
• Dental & Orthodontia Benefits
• Vision Benefits
• Health Savings Account (HSA)
• Health and Dependent Care Flexible Spending Accounts
• Voluntary Life Insurance, Long-Term & Short-Term Disability Insurance
• Hospital Indemnity Insurance
• 401(k) including match with pre and post-tax options
• Paid Sick Time Leave
• Legal and Identity Protection Plans
• Pre-tax Commuter Benefit
• 529 College Saver Plan

Motion Recruitment Partners (MRP) is an Equal Opportunity Employer. All applicants must be currently authorized to work on a full-time basis in the country for which they are applying, and no sponsorship is currently available. Employment is subject to the successful completion of a pre-employment screening. Accommodation will be provided in all parts of the hiring process as required under MRP’s Employment Accommodation policy. Applicants need to make their needs known in advance.