Senior Data Engineer (Microsoft Fabric)
- Sandton, Johannesburg
- Permanent
- Full-time
In this role, you will be instrumental in designing and implementing scalable data solutions using Microsoft Fabric and Azure technologies. You will collaborate with cross-functional teams to enable data-driven decision-making and support our digital transformation initiatives.Key Responsibilities:
- Design and develop robust data pipelines using Microsoft Fabric components such as OneLake, Dataflows Gen2, and Lakehouse.
- Implement ETL/ELT processes using Azure Data Factory, PySpark, Spark SQL, and Python.
- Optimise and manage SQL queries and data models within Azure Synapse Analytics.
- Ingest, transform, and load structured and unstructured data from various sources.
- Ensure data quality, integrity and security across cloud platforms.
- Collaborate with analytics engineers, architects, and business stakeholders to deliver data solutions aligned with business needs.
- Support hybrid cloud deployments and integrations between on-premises and cloud environments.
- Maintain compliance with data governance and privacy regulations.
- Bachelor's degree in computer science, Engineering, or related field.
- 5-8 years of experience in data engineering or cloud data development.
- Hands-on experience with Microsoft Fabric and Azure Data Services (ADF, Synapse, Data Lake, Azure SQL, Databricks).
- Proficiency in SQL, Python, PySpark, and Spark SQL.
- Familiarity with Kusto Query Language (KQL) is advantageous.
- Strong understanding of data warehousing, dimensional modeling, and big data technologies.
- Experience with CI/CD pipelines and DevOps practices.
- Microsoft Certified: Fabric Data Engineer Associate
- Azure Data Engineer Associate