We are seeking a Senior Data Platform Engineer for a 6+ month contract position based in Charlotte, North Carolina. This role focuses on Cloudera platform engineering, big data infrastructure, and cloud-based lakehouse architecture within a financial services environment.
Responsibilities
Administer and provide production support for Cloudera clusters in enterprise environments
Develop, maintain, and troubleshoot enterprise-scale data pipelines using Spark and PySpark
Design and optimize distributed systems for performance and reliability
Support modern cloud data platforms and lakehouse architectures on Azure and Databricks
Perform distributed systems troubleshooting and performance tuning
Qualifications
Required
7–10+ years of data engineering or data platform engineering experience
Hands-on Cloudera administration and production support experience managing and supporting Cloudera clusters
Strong Spark, PySpark, and Python development experience
Distributed systems troubleshooting and performance tuning experience
Financial services or capital markets experience
Preferred
Experience with Azure, Databricks, and modern lakehouse architectures
Familiarity with Iceberg table format