Title
Senior Data Engineer - Engineering, Energy & Infrastructure
Role: Senior Data Engineer - Engineering, Energy & Infrastructure
Location: Bangaluru (in-person)
Level: Senior
Role Purpose
We are looking for an experienced Senior Data Engineer to design, build and operate scalable data solutions supporting major engineering, energy, oil & gas and infrastructure programmes.
The role will work closely with Enterprise Data Architects, engineering teams, project controls and business stakeholders to turn complex information from engineering, project, commercial and operational systems into trusted, reusable and AI-ready data products.
The successful candidate will have extensive hands-on experience with Azure Databricks, modern lakehouse architectures and large-scale data integration. They will be comfortable working with highly complex datasets spanning engineering systems, documents, project controls, procurement, asset information, geospatial data and operational systems.
Key Responsibilities
Enterprise Data Architecture
Design, build and maintain scalable enterprise data pipelines using Azure Databricks.
Ingest structured, semi-structured and unstructured data from complex enterprise and engineering systems.
Implement Bronze, Silver and Gold/Medallion data architectures.
Develop reusable ingestion and transformation frameworks rather than project-specific point solutions.
Build batch, incremental and streaming pipelines appropriate to different data sources and latency requirements.
Show the full description
Develop transformation logic that converts complex source data into governed enterprise and domain data models.
Build robust data pipelines with appropriate monitoring, error handling, observability and recovery capabilities.
Optimise pipelines and Databricks workloads for performance, reliability and cost.
Databricks Architecture
Provide strong hands-on engineering capability across
Azure Databricks
Apache Spark / PySpark
SQL
Python
Delta Lake
Delta Live Tables / Lakeflow
Databricks Workflows
Unity Catalog
Databricks SQL
Structured Streaming
Change Data Capture
Data sharing
CI/CD and Infrastructure as Code
Data quality and observability
Performance optimisation
Required Experience
The successful candidate should bring
7+ years’ experience in data engineering, data platform engineering or an equivalent discipline.
3+ years of substantial Azure Databricks experience, ideally within enterprise-scale environments.
3+ years’ applicable industry experience.
Strong hands-on capability with Python, PySpark and SQL.
Strong knowledge of Spark, Delta Lake and lakehouse architectures.
Experience designing and implementing enterprise-grade data ingestion and transformation pipelines.
Experience implementing Medallion/Bronze-Silver-Gold architectures.
Experience working with complex data models and translating logical models into physical implementations.
Experience with Unity Catalog, data lineage and data governance.
Experience implementing production-grade CI/CD, testing, monitoring and deployment practices for data solutions.
Experience handling large volumes of structured and unstructured data.
Strong understanding of cloud architecture, preferably Microsoft Azure.
Experience working alongside architects, data scientists, analysts and business/domain SMEs.
Highly Desirable
Experience with one or more of
Microsoft Fabric
Microsoft Purview
Power BI semantic models
Azure Data Lake Storage
Knowledge graphs and ontologies
Digital twins
CFIHOS or similar industry information standards
Belong. Connect. Grow. with KBR!