DevSecOps Platform Engineer

About the Role

Our client is seeking a highly skilled DevSecOps Platform Engineer to build, secure, and operate large-scale, mission-critical infrastructure supporting big data, analytics, AI/ML, and core business platforms. This role combines deep platform engineering expertise with strong security, automation, and observability capabilities to ensure the environment remains resilient, compliant, and optimized for performance.

You will work across containerized environments, big data ecosystems, and cloud-native technologies to deliver reliable services while enforcing security policies, preventing configuration drift, and enabling automation across the platform.

Key Responsibilities Core Platform Engineering

• Build, maintain, and secure highly available, scalable infrastructure supporting technologies such as Object Storage, OpenShift, Spark, Iceberg, Yunikorn, and Trino.

• Monitor and remediate configuration drift; enforce platform and infrastructure security policies.

• Configure and monitor Big Data ecosystem components using BI tools and observability platforms.

• Develop automated regression and performance test suites to validate platform health and stability.

• Perform routine maintenance including cluster scaling, patching, and version upgrades.

• Conduct regular security audits and enforce runtime policies and operational guardrails.

Security & Access Control

• Implement and manage OAuth authentication, TLS/SSL encryption, and RBAC/ABAC access models.

• Ensure strong data protection standards, including encryption at rest and in transit.

• Validate compliance with enterprise IAM requirements and regulatory frameworks such as GDPR and HIPAA where applicable.

• Harden containerized workloads and ensure secure configurations across Kubernetes and all supporting components.

Monitoring, Observability & Operations

• Monitor system health, performance, and events across compute, storage, and data pipeline layers.

• Implement observability across big data, Kubernetes, and platform services using tools such as Prometheus, Grafana, and other enterprise-supported technologies.

• Partner with operations teams to ensure resiliency, high availability, and disaster recovery practices are tested and maintained.

Automation, CI/CD & DevSecOps

• Build automated IaC pipelines using Helm, Terraform, Python, and Linux shell scripting.

• Enable secure, repeatable provisioning for platform components and application services.

• Integrate infrastructure changes into CI/CD workflows to enforce policy, quality, and compliance standards.

Technical Skills Required Programming & Scripting

• Python, Bash, Shell, SQL

• Basic Java experience; Scala is a plus for big data environments

• Strong scripting skills for platform automation and operational tooling

Operating Systems & Containers

• Deep knowledge of Linux, system programming, performance tuning, and networking

• Expertise with Kubernetes, OpenShift (OCP), Helm charts, Terraform, and container orchestration

• Experience deploying and managing workloads in large-scale enterprise clusters

Big Data & Data Engineering

• Hands-on experience with:

• Apache Spark, Hadoop, Hive, Trino, Iceberg, NexusOne

• ETL tools such as Airflow or NiFi (nice to have)

• Batch and streaming pipelines using Kafka, Flink

• Object storage systems (S3, NetApp StorageGrid)

Strong understanding of data formats including Parquet/Avro, ORC, JSON, CSV

AI/ML & Model Ops (Nice to Have)

• Experience with ML workflows, LLM-related tooling, or model-ops platforms

• Familiarity with MLflow, Kubeflow, or SageMaker

• Conceptual understanding of feature engineering, model deployment, and inference pipelines

Security & Compliance

• RBAC and ABAC access control models

• Encryption standards, TLS/SSL, and KMS solutions

• Familiarity with compliance frameworks such as GDPR, HIPAA (as applicable), and IAM policy governance

Architecture & System Design (Good to Have)

• Microservices and event-driven design principles

• Caching, load balancing, and horizontal scaling strategies

• High availability, failover, disaster recovery, and monitoring architecture

Qualifications

• Significant hands-on experience in DevSecOps, Platform Engineering, Data Infrastructure, or Cloud-Native Engineering roles

• Expertise operating large-scale, distributed systems in regulated enterprise environments

• Strong cross-functional communication skills and the ability to collaborate with security, data engineering, and operations teams

• Ability to troubleshoot, optimize, and secure complex systems across compute, storage, and data layers