Source-to-Target Reconciliation: Check data completeness, null values, duplicates, and business rule transformations across ingestion tiers.
Automated Regression Suites: Write scripts to automatically test pipelines and data outputs after every schema or code change.
Root Cause Analysis (RCA): Investigate discrepancies across ETL jobs, semantic models, and visual dashboards.
Data & Schema Integrity Testing
Schema Drift & Integrity: Test pipeline resilience against upstream column or data type changes, and validate primary/foreign keys, constraints, and boundary conditions across Lakehouse and Warehouse tables
Null & Duplicate Checks: Automate validation for unauthorized nulls, truncation, formatting anomalies, and duplicate records across Medallion layers
Data Observability & Monitoring
SLAs & Lineage: Track metrics for freshness, volume anomalies, and latency, and audit end-to-end lineage from raw sources to Power BI models
Alerting Frameworks: Configure automated alerts via Azure Log Analytics, Fabric monitoring hubs, or webhooks for data quality threshold failures
Requirements
Platform Architecture & Scripting
Fabric Architecture: Utilize deep knowledge of OneLake, Lakehouse, Data Warehouse, Dataflows Gen2, Pipelines, Medallion architecture, and Delta Lake formats
Automation & Scripting: Write SQL, T-SQL, Python, PySpark, or Spark SQL for reconciliation and regression testing using frameworks like Great Expectations or Soda
Pipeline & Power BI Validation
Error Handling: Test data movement, retry logic, failure handling, and incremental, delta, or historical load scenarios
Semantic Models & CI/CD: Validate report metrics, complex DAX, relationships, RLS, and integrate automated quality checks into Azure DevOps, GitHub Actions, or Fabric Git
Bachelor's degree in Computer Science, Information Technology, Engineering, or a related discipline, or equivalent practical experience
Typically 5–8 years of QA or test automation experience
Demonstrated hands-on experience building automation frameworks rather than only executing existing test scripts
Ability to independently design test strategies, implement automation, troubleshoot failures, and communicate results
Strong collaboration skills when working with data engineering, BI, AI, and DevOps teams
What’s in it for you?
Strong community: Work alongside top professionals in a friendly, open-door environment
Growth focus: Take on large-scale projects with a global impact and expand your expertise
Tailored learning: Boost your skills with internal events (meetups, conferences, workshops), Udemy access, language courses, and company-paid certifications
Endless opportunities: Explore diverse domains through internal mobility, finding the best fit to gain hands-on experience with cutting-edge technologies
Care: We’ve got you covered with company-paid medical insurance, mental health support, and financial & legal consultations
About us
At Ciklum, we are always exploring innovations, empowering each other to achieve more, and engineering solutions that matter. With us, you’ll work with cutting-edge technologies, contribute to impactful projects, and be part of a One Team culture that values collaboration and progress.
India is a strategic innovation hub for Ciklum, with growing teams in Chennai and Pune leading advancements in EdgeTech, AR/VR, IoT, and beyond. Join us to collaborate on game-changing solutions and take your career to the next level.
Explore, empower, engineer with Ciklum!
Interested already? We would love to get to know you! Submit your application. We can’t wait to see you at Ciklum.
#LI-RB1