
SENIOR DATA ENGINEER (AZURE) - FULLY REMOTE - UP TO R1.1M PER ANNUM
- South Africa
- Permanent
- Full-time
- 8+ years of relational SQL database
- Solid understanding of Apache Spark as a distributed data processing framework
- Experience in designing, implementing and performance tuning solutions in Apache Spark
- Experience in complex data warehouse and data lake design
- Experience in building, optimising and manging data pipelines for large and complex datasets
- Experience using Azure cloud data platform technologies:
- Azure Storage / Data Lake
- Azure SQL Database
- Azure Data Factory
- Azure Databricks
- Azure Synapse Analytics to implement data pipelines and analytical solutions
- Experience in Python would be beneficial
- Experience with streaming technologies such as Spark streaming or Kafka would be beneficial
- A relevant data engineering certification would be beneficial
Job Mail