Applies reuse-first, AI-assisted practices to strengthen SDLC-quality routines for data pipelines (e.g., test generation and control validation), ensuring traceability/auditability and alignment to resiliency and security expectations.
Strong experience developing reusable data integration and aggregation layers using Java and/or Python to dynamically acquire, transform, correlate, and expose data for analytical and operational use cases
Familiarity with cloud-based data and integration platforms, preferably AWS, Azure, GCP, Pivotal Cloud Foundry or equivalent enterprise cloud technologies.
Experience building AI assisted metadata-driven and configuration-driven dashboards, enabling new data sources, KPIs, filters, and visualizations to be introduced with minimal custom development.
Required qualifications, capabilities, and skills
Formal training or certification on data engineering concepts and 3+ years applied experience
Experience across the data lifecycle
Demonstrated experience using enterprise-authorized AI capabilities within the work environment to support data engineering workflows with strong validation habits and awareness of data sensitivity.
Ability to review and validate AI-assisted outputs (e.g., query suggestions, test ideas, or model change summaries) before use, escalating when uncertain and following data handling requirements.
Advanced SQL skills (e.g., joins and aggregations) and working understanding of NoSQL databases
Hands-on experience with designing and developing RESTful APIs and microservices using Java/Spring Boot or Python/FastAPI.
Strong understanding of API design, including versioning, pagination, error handling, authentication/authorization, resiliency, and API lifecycle management
Significant experience with statistical data analysis and able to determine appropriate tools and data patterns to perform analysis
Experience customizing changes in tools to generate product outputs
Preferred qualifications, capabilities, and skills
Cloud and AI certifications preferred
In depth understanding of Data scalability, resiliency, stability, availability, controls and governance is plus
Working knowledge of Observability Tools like Splunk, Grafana, Dynatrace for system monitoring and alerting(business/infrastructure)
Operational support experience is bonus
Working experience with batch and real-time/streaming integration patterns, including technologies such as Apache Kafka is preferred.