Experience with medallion data architecture
Experience building a datalakehouse (data lake + delta tables)
Work with various data sources including CSVs, APIs, and automated activities
Implement ETL processes from OneDrive to bronze, silver, and gold layers using Delta tables
Persist the gold layer data to a SQL endpoint for Power BI users
Assist in data architecture and design decisions
Implement auditing and error handling mechanisms in data pipelines
Collaborate with the team to troubleshoot and resolve data-related issues
Participate in code reviews and ensure code quality
Support the testing phase and help resolve tickets
Contribute to architectural decisions and improvements
Tech Stack: Microsoft Stack, Fabric Notebooks, Delta Tables, SQL Endpoints, Power BI, OneDrive, CSVs, APIs, Data Volume, Approximately 25 to 50 gigabytes per week, Expected growth to terabytes over time, 225 clients with 8-10 CSVs per week, each CSV roughly 30-50 megabytes.
Workplace: Remote position for candidates based in LATAM, preferably Argentina.
Must Have Skills
Strong knowledge of the Microsoft stack
Experience with Microsoft Fabric
Experience with SQL
Previous working experience with Spark and Notebooks
Familiarity with Python
Understanding of ETL processes
Experience with data warehousing concepts
Ability to work with various data formats such as CSVs and APIs
Basic understanding of Power BI
Preferred Skills
Familiarity with Delta tables
Understanding of data partitioning
Experience with Azure DevOps or GitHub
Previous experience working with data volumes in the range of gigabytes to terabytes
Professional Skills
Good English communication and collaboration skills
Ability to work hands-on and solve problems independently
Maintains composure during all types of situations and is collaborative by nature
High standards of professionalism, consistently producing high quality results
Self-sufficient, independent requiring very little supervision or intervention
Demonstrate flexibility and openness to bring creative solutions to address issues
Bridgenext is an Equal Opportunity Employer