Tune Spark and SQL performance and manage compute cost
Own data quality, observability, and reliability through automation, testing, and monitoring
Apply data governance and access controls through Unity Catalog
Lead design reviews and mentor engineers on data engineering best practices
Our stack includes
Languages: Go (APIs/services), Python/PySpark, Spark SQL, Scala (data pipelines)
Databricks: Delta Lake, Unity Catalog, PySpark/Spark SQL, Databricks SQL warehouses, Workflows/Jobs, notebooks, materialized views, SQL table-valued functions
AWS and data stores: S3, RDS, Kafka, Aurora (PostgreSQL)
Platform and DevOps: GitHub, GitHub Actions, Docker, Kubernetes, ECS, EKS, Terraform
Collaboration: Jira, Confluence, Slack
We are looking for someone having
5+ years of software or data engineering experience, including 3+ years building production data pipelines on Databricks or an equivalent Spark platform in AWS
Experience delivering production-grade, fault-tolerant software in a fast-paced environment with a distributed team
Advanced SQL skills, including tuning complex analytical queries over large datasets
Expertise in data warehousing, lakehouse concepts, data modeling, and cloud data architecture
Strong applied knowledge of several of: Unity Catalog governance, batch and incremental ETL/ELT, Spark performance tuning, REST services, AWS data services (Athena, Glue, EMR, Lambda), Terraform, GitHub Actions, and Git
A Bachelor’s degree in Computer Science or a related field, or equivalent experience
Nice to have
Education or publishing domain experience
Streaming/CDC ingestion (e.g., Kafka) into Delta Lake
Data quality frameworks (Delta Live Tables, Great Expectations)
Databricks certification
Why work for us?
The work you do at McGraw Hill will be work that matters. We are collectively designing content that will build the future of education. Play your part and experience a sense of fulfilment that will inspire you to even greater heights.
The pay range for this position is between $124,300 - $160,000 annually. However, base pay offered may vary depending on job-related knowledge, skills, experience, and location. Additionally, a full range of medical and/or other benefits may be provided, depending on the position offered. Click here to learn more about our benefit offerings.
McGraw Hill recruiters always use a “@mheducation.com” or "@careers.mheducation.com” email addresses and/or from our Applicant Tracking System, iCIMS. Any variation of this email domain should be considered suspicious. Additionally, McGraw Hill recruiters and authorized representatives will never request sensitive information in email. 51308
