Build ETL/ELT processes that ingest, transform, and deliver data from a variety of source systems into curated, analytics-ready datasets.
Implement data quality checks, validation logic, and monitoring/alerting to ensure pipeline reliability and data accuracy.
Escalation & Production Support — Act as a primary point of escalation for production data pipeline issues, performing root-cause analysis, troubleshooting failures, and implementing timely fixes.
Partner with support and business teams to triage incoming issues, communicate status, and drive incidents to resolution within SLA.
Document recurring issues and implement long-term fixes or process improvements to reduce future escalations.
Azure-to-Databricks Migration — Lead and execute the migration of existing Azure Data Factory pipelines and Azure Functions to the Databricks platform, re-architecting logic as needed to leverage Databricks-native capabilities.
Validate data parity and pipeline performance between legacy Azure-based solutions and their Databricks replacements, ensuring a clean, low-risk cutover.
Retire legacy Azure Data Factory/Azure Functions components once migrations are validated and stable.
Collaboration & Best Practices — Collaborate with data architects, analysts, and business stakeholders to translate requirements into technical designs.
Follow version control, code review, and CI/CD best practices for all pipeline code and configuration.
Contribute to documentation of pipeline architecture, data flows, and operational runbooks
Embody AnewHealth’s Core Values in all communications and interactions.
Other duties as assigned.
The above essential functions are representative of major duties of positions in this job classification. Specific duties and responsibilities may vary based upon departmental needs. Other duties may be assigned similar to the above consistent with knowledge, skills and abilities required for the job. Not all of the duties may be assigned to a position.
Qualifications
These represent the desired qualifications of the ideal candidate. They are not meant to limit consideration for candidates who do not meet all of the standards listed. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.
Education
Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field, or equivalent practical experience
Experience
Required: 3+ years of experience as a Data Engineer building and supporting production data pipelines.
Hands-on experience developing data pipelines in Databricks, including PySpark, Delta Lake, and Databricks Workflows/Jobs.
Experience with Azure Data Factory and/or Azure Functions, with the ability to interpret existing ADF pipelines/Functions and re-implement them in Databricks.
Skills and Abilities
Strong SQL skills, including query optimization and experience with relational and dimensional data models.
Proficiency in Python for data engineering and pipeline automation.
Working knowledge of the broader Azure cloud ecosystem (e.g., Azure Data Lake Storage, Azure SQL Database, Azure Key Vault).
Solid understanding of ETL/ELT design patterns, data warehousing concepts, and data quality/validation practices.
Strong troubleshooting and analytical skills, with the ability to diagnose and resolve production issues under time pressure.
Excellent communication skills, with the ability to explain technical issues clearly to both technical and non-technical stakeholders.
Physical/Mental Demands: [Refer to Job Analysis Questionnaire and/or options below]
[If Remote/home office]: This position is administrative in nature and will present physical demands requisite to a position requiring: hearing, seeing, sitting, standing, talking, and walking. The physical demands described here are representative of those that must be met by an employee to successfully perform the essential functions of this job.
Must be able to commute to multiple site locations within assigned territory. May be necessary to work extended hours as needed.
Schedule
This is a full-time position with an expectation to work an average of 40 hours per week and be available outside of normal business hours to meet customer expectations on an ad-hoc basis. Schedules are set to accommodate the requirements of the position and the needs of the organization and may be adjusted as needed.
Travel
Travel may be required for special organization or department events, department team meetings, trade shows, conferences, and other client engagements.
Supervisory: No
This is a remote position.
AnewHealth offers a comprehensive benefit package for full-time employees that includes medical/dental/vision, flexible spending, company-paid life insurance and short-term disability as well as voluntary benefits, 401(k), Paid Time Off and paid holidays. Medical, dental and vision coverage are effective 1st of the month following date of hire.
AnewHealth provides equal employment opportunity to all qualified applicants regardless of race, color, religion, national origin, sex, sexual orientation, gender identity, age, disability, genetic information, or veteran status, or other legally protected classification in the state in which a person is seeking employment. Applicants are encouraged to confidentially self-identify when applying. Local applicants are encouraged to apply. We maintain a drug-free work environment. Applicants must be eligible to work in this country.
