Develop and operate workflow orchestration (e.g., Apache Airflow) to schedule, monitor, and manage data movement and transformations
Model and transform data for analytics using SQL and dbt to support business intelligence and reporting workloads
Write production-grade Python/PySpark code with disciplined testing, performance tuning, and maintainable object-oriented design
Implement infrastructure-as-code (e.g., Terraform) to provision and manage cloud-based data platform components
Containerize and deploy services using Docker and Kubernetes (and related tooling such as Helm)
Collaborate with analysts, data scientists, and application teams to turn requirements into technical designs and delivered solutions
Own critical data systems by improving reliability, scalability, security, and operational excellence
Mentor junior engineers and influence the team’s technical direction through standards, reviews, and knowledge sharing
Uses enterprise-authorized AI capabilities within the work environment to accelerate data platform and model design analysis and documentation, validating outputs and handling data according to sensitivity and security requirements
Applies reuse-first, AI-assisted practices within delivery and operational routines (e.g., backup/recovery validation and access control review support), ensuring traceability/auditability and alignment to resiliency and security expectations
Required qualifications, capabilities, and skills
Degree in Computer Science or a STEM-related field (or equivalent)
Demonstrated experience delivering in an agile, fast-paced engineering environment
8 years of recent, hands-on professional experience actively coding as a data engineer
Strong software engineering fundamentals (system design, data structures, object-oriented programming, testing strategies, and end-to-end development lifecycle)
Strong Python programming skills, including unit and integration testing
Hands-on experience building and operating cloud-based data platforms using major cloud services (e.g., AWS, Google Cloud, or Azure)
Experience with large-scale distributed data processing and performance tuning
Hands-on experience with modern data warehousing/lakehouse technologies (e.g., Redshift, BigQuery, Snowflake; and engines such as Spark, Flink, or Trino; and table formats such as Iceberg, Hudi, or similar)
Strong SQL skills and experience with SQL-based transformation tooling (e.g., dbt)
Experience designing and operating orchestration pipelines using Airflow or similar tools
Experience designing and building streaming pipelines using Kafka, Pub/Sub, or similar messaging systems
Demonstrated experience using enterprise-authorized AI capabilities within the work environment to support data engineering workflows with strong validation habits and awareness of data sensitivity
Ability to review and validate AI-assisted outputs (e.g., model/design summaries or operational checklists) before use, escalating when uncertain and following data handling requirements
Preferred qualifications, capabilities, and skills
Data modeling experience for analytics and reporting use cases
Knowledge of security, risk, compliance, and governance considerations for data platforms
Experience building continuous integration and continuous delivery automation for data and platform services
Experience with container-based deployment environments (Docker, Kubernetes, etc.)
Demonstrated ability to coach teammates on engineering practices and contribute to a collaborative, inclusive team culture