Responsibilities include but are not limited to
Develop and maintain data pipelines using MS Fabric
Implement transformations using notebooks (Python, pyspark, sql)
Experience with medallion data architecture
Experience building a data lakehouse (data lake + delta tables)
Work with various data sources, including CSVs, APIs, and automated activities
Implement ETL processes from OneDrive to bronze, silver, and gold layers using Delta tables
Persist the gold layer data to a SQL endpoint for Power BI users
Assist in data architecture and design decisions
Implement auditing and error handling mechanisms in data pipelines
Collaborate with the team to troubleshoot and resolve data-related issues
Participate in code reviews and ensure code quality
Support the testing phase and help resolve tickets
Contribute to architectural decisions and improvements
Workplace: LATAM
Technical Environment: Microsoft Stack, Fabric Notebooks, Delta Tables, SQL Endpoints, Power BI, OneDrive, CSVs, APIs
Must Have Skills
Strong knowledge of the Microsoft stack
Experience with Microsoft Fabric
Experience with SQL
Familiarity with Python
Understanding of ETL processes
Experience with data warehousing concepts
Ability to work with various data formats such as CSVs and APIs
Basic understanding of Power BI
Ability to work hands-on and solve problems independently
Preferred Skills
Familiarity with Delta tables
Understanding of data partitioning
Experience with Azure DevOps or GitHub
Previous experience working with data volumes in the range of gigabytes to terabytes
Professional Skills
Strong English communication skills
Strong team collaboration skills
Maintains composure during all types of situations and is collaborative by nature
High standards of professionalism, consistently producing high quality results
Self-sufficient, independent requiring very little supervision or intervention
Demonstrate flexibility and openness to bring creative solutions to address issues
Bridgenext is an Equal Opportunity Employer