Design, architect, and optimize data pipelines, lakehouse structures, and data models to support analytical reporting and AI/ML initiatives.
Develop, implement, and maintain scalable ETL/ELT workflows using modern data platforms, cloud-native technologies, and data engineering best practices.
Ensure data quality, pipeline reliability, and system performance through testing, monitoring, validation, and SLA-driven controls.
What You Will Need
Education and Experience
A minimum of a bachelor’s Degree or the equivalent in work experience and training.
A minimum of 5 years of experience building data pipelines on cloud platforms such as AWS, Azure, or Google Cloud.
Demonstrated experience designing and maintaining Lakehouse or data warehouse architectures (e.g., Databricks, Snowflake, Redshift, or equivalent).
Proven experience supporting AI/ML workloads through feature engineering, data preparation, or embedding pipelines.
Strong background in data governance, lineage tracking, and quality monitoring in production environments.
Knowledge, Skills, and Abilities
Strong technical learning ability, with the capacity to apply knowledge and support team development.
Ability to mentor junior consultants and share expertise effectively.
Strong client communication and listening skills, with the ability to identify needs and develop solutions.
Adaptable and proactive in supporting change, improving processes, and driving results.
Business-minded, with an understanding of performance goals and opportunities for growth.
Accountable, dependable, detail-oriented, and capable of sound independent judgment.
Strong problem-solving, root cause analysis, and time management skills.
Proficient in Python and SQL, with familiarity in Spark and distributed data processing.
Experience with streaming technologies, AI/ML data systems, data governance tools, Docker, and Kubernetes.
Working knowledge of health, safety, quality, and environmental management practices.
Ability to learn the ABS Health, Safety, Quality, and Environmental Management Systems.
Salary: $120,000 - $155,000
Reporting Relationships
Reports to a manager, director, or executive-level position and does not have any direct reports.