Lead a Scrum team building cutting-edge data utilities, setting technical direction, decomposing complex problems into deliverable work, and unblocking engineers without holding a reporting line
Build and develop the team's technical capability — mentoring engineers, raising code-review standards, growing depth in the platform stack, and creating the conditions for a self-reliant, high-performing team
Provide recommendations and insight on data management and governance procedures applicable to the acquisition, maintenance, validation, and utilization of data — spanning Data Governance, Data Quality, Data Profiling, and Data Lineage
Use the latest enterprise-authorized generative AI and agentic AI capabilities to accelerate design, implementation, testing, and technical documentation — validating outputs and handling data according to sensitivity and security requirements
Design and deliver trusted data collection, storage, access, and analytics platform solutions across AWS, Databricks, and Snowflake
Build streaming and low-latency serving components using Kafka, Cassandra, and related AWS services to support real-time consumption
Partner closely with product, architecture, modeling, and model-deployment teams to understand data requirements and deliver the engineering that feeds and serves them
Apply reuse-first, AI-assisted practices within delivery and operational routines — ensuring traceability, auditability, and alignment to resiliency and security expectations
Present technical designs, platform metrics, and data insights to engineering and business stakeholders through clear visual delivery
Required qualifications, capabilities, and skills
Formal training or certification on software engineering concepts and 5+ years applied experience
Strong hands-on programming expertise in Java, Python, and Scala
Demonstrated experience building frameworks and platforms — not just applications — that other teams adopt and build on
Proven experience delivering both high-throughput real-time systems and high-volume Spark processing over very large datasets, with a working command of performance tuning at scale
Deep hands-on experience with AWS (compute, serverless, managed data services, IAM) and Databricks — including Unity Catalog, Delta Lake, Lakeflow, Delta Live Tables, Catalog Sharing, fine-grained access control, and SQL Warehouses
Hands-on experience with Snowflake in a production data platform environment
Working experience with Kafka, Cassandra, and related AWS streaming and NoSQL offerings
Strong understanding of both relational and NoSQL databases, including data modeling trade-offs between them
Demonstrated experience using enterprise-authorized generative AI capabilities to accelerate engineering delivery, with strong validation habits and awareness of data sensitivity
Experience working on AI/ML systems, with a solid understanding of core model families — decision trees, ensemble methods, and neural networks — and a conceptual understanding of transformer models
Mastery of Agile/Scrum delivery in practice
Preferred qualifications, capabilities, and skills
Experience mentoring and growing engineers and building team technical capability without formal management authority
AWS, Databricks, and/or Snowflake certifications
Strong grasp of Data Governance, Data Quality, Data Profiling, and Data Lineage in regulated environments
Hands-on experience with feature provisioning for ML — including Feature Store on Unity Catalog
Experience adopting agentic AI development tooling on a team and measurably accelerating deliver
Exposure to cloud migration or platform modernization at scale
