Drive a consistent multi-cloud Databricks strategy, enabling scalable and interoperable data platforms across environments.
Optimise performance across pipelines, compute, storage, and orchestration frameworks, embedding cost-efficiency and scalability.
Define and implement CI/CD for data platforms, supporting automated testing, secure deployments, and multi-environment promotion.
Embed robust data governance, security, and lifecycle controls, ensuring compliance through classification, encryption, access management, and lineage frameworks (e.g., Unity Catalog, Purview, Lake Formation).
Act as a senior SME for troubleshooting complex issues, leading root-cause analysis and long-term remediation of data quality and platform challenges.
Lead, mentor, and grow a community of Data Engineers, driving technical excellence through coaching, reviews, and knowledge sharing.
Operate effectively across a matrix organisation, influencing architecture, cyber, product, and senior stakeholders.
Communicate complex technical concepts clearly, articulating trade-offs, risks, and strategic decisions to both technical and non-technical audiences.
What you’ll need to do the role
Expert-level experience in enterprise-scale data engineering, including defining standards, patterns, and overseeing complex delivery.
Advanced proficiency in PySpark and SQL, with deep expertise in performance optimisation and scalable data processing.
Strong experience in data modelling and large-scale data integration design, with the ability to build robust, maintainable, and testable pipelines.
Proven ability to embed testing frameworks, observability, and data quality controls across engineering workflows.
Deep hands-on experience with Databricks (essential), including lakehouse architecture, Delta Lake, Unity Catalog, and streaming technologies.
Broad cloud expertise across Azure (Synapse, ADF, Event Hub, ADLS Gen2, Purview, Key Vault) and AWS (S3, Glue, EMR, Kinesis, Athena, Lake Formation, IAM), with strong multi-cloud experience.
Strong understanding of modern engineering practices, including CI/CD for data platforms, automated deployment pipelines, and environment promotion strategies.
Experience designing monitoring, observability, and cost optimisation frameworks, alongside governance, lineage, cataloguing, and compliance at scale.
Excellent stakeholder management skills, with the ability to influence senior leaders and work effectively across matrixed organisations.
Proven leadership capability, including mentoring, coaching, and developing engineering teams.
Strong communication skills, with the ability to translate complex technical concepts into clear business value.
8+ years’ experience in data engineering within enterprise environments.
Relevant certifications (desirable), such as Azure Data Engineer Associate, AWS Data Analytics Specialty, or Databricks Data Engineer (Associate/Professional).
SC clearance (or willingness to obtain it)
What we offer
Company car
5% on target bonus scheme
Private medical insurance
Flexible working considered
Pension – 6%
Chance to contribute to innovation in the public services
A company passionate about diversity and inclusion
Serco discounts which include cinema, merlin entertainment and online shopping discounts, and discounts on mobile phone plans and leisure centre memberships.
A range of benefits to support the health and wellbeing of you and your family such as Employee Assistance Programme, Simply Health Cash Plans, and more.
A wealth of career development training to suit your future aspirations. These range from role specific training, leadership coaching, formal study and much more to support you to build your career with Serco.
A safe and supportive culture.
.
A little bit about us
At Serco, everyone plays a vital part in delivering essential public services that make a real difference. As a global team of 50,000 people across Defence, Transport, Justice, Immigration, Healthcare, Leisure and Citizen Services, we’re united by a shared purpose: to improve the services that communities rely on. Guided by our values of Trust, Care, Innovation and Pride, our people make meaningful impact, every single day.
Our inclusive recruitment commitment
We prioritise your skills and potential. As a Disability Confident Leader, the Top Great British Employer of Veterans 2026, and a Gold Inclusive Employer Standard holder, we champion equal opportunities for all. We offer flexible and hybrid working where possible and make reasonable adjustments throughout recruitment and employment.
Guaranteed Interview Scheme: Applicants with disabilities, veterans and people with convictions, who meet the minimum job criteria, are guaranteed an interview. Simply opt into the relevant scheme on the application form.
Ban The Box: We also support fair access for those with unspent criminal convictions through our ‘Ban the Box’ pledge (some roles may have security exemptions).
For support with your application, please contact recruitmentuk@serco.com.
ddatjobs