Fact & Dimension models
Star Schema
Snowflake Schema
Experience processing large-volume data and performing SQL performance tuning.
Experience integrating with REST APIs and external data providers.
Experience with SFTP and file-based integrations.
Strong knowledge of data validation, reconciliation, and quality controls.
Proven production support and troubleshooting skills.
Experience using Git, source control practices, CI/CD, and deployment automation.
Experience working across on-premises, hybrid, and cloud data platforms.
Preferred AI / GenAI Experience
Candidates with exposure to AI-enabled data engineering solutions will be highly valued.
Experience incorporating AI/GenAI capabilities into data engineering solutions.
Experience with Azure OpenAI Service or OpenAI API integrations.
Python-based AI automation and intelligent workflow development.
AI-assisted data quality monitoring, anomaly detection, and operational troubleshooting.
Understanding of
Retrieval-Augmented Generation (RAG)
Embeddings
Vector Databases
Additional Preferred Skills
Python
PySpark
Databricks
Snowflake
Azure Synapse Analytics
Microsoft Fabric
MongoDB / NoSQL databases
PowerShell scripting
Data Lake and Lakehouse architectures
Desired Candidate Profile
The successful candidate will
Be highly hands-on and technically strong in data engineering.
Demonstrate the ability to work independently with minimal supervision.
Quickly understand and troubleshoot complex legacy and modern data platforms.
Possess strong analytical and problem-solving skills.
Have experience supporting mission-critical production environments.
Be comfortable driving modernization initiatives and recommending best practices.
Communicate effectively with both technical and business stakeholders.
Take ownership of deliverables and operational outcomes.
Nice-to-Have Industry Experience
Enterprise Data Warehousing
Financial Services
Healthcare
Retail & Consumer Data Platforms
SaaS and Cloud-Native Data Environments
Key Responsibilities
Design, develop, and maintain scalable ETL/ELT solutions and data pipelines.
Support and enhance enterprise data warehouse solutions.
Analyze existing SSIS packages and lead modernization efforts toward Azure Data Factory and modern cloud-based architectures.
Build and optimize data ingestion, transformation, and integration processes.
Perform advanced SQL development, query optimization, and performance tuning for large-volume datasets.
Develop integrations with REST APIs, third-party systems, and file-based interfaces.
Support SFTP-based and batch data exchange processes.
Troubleshoot production issues, perform root-cause analysis, and implement preventive solutions.
Ensure data quality through reconciliation, validation, monitoring, and exception handling.
Collaborate with business and technical stakeholders to gather requirements and build data solutions.
Implement CI/CD pipelines and source control best practices for data engineering solutions.
Support hybrid environments involving on-premises and cloud-based systems.
Participate in architecture discussions and recommend modernization strategies.
