AWS Data Engineer - Midrand - Semi Remote - Contract R780 PH
e-Merge IT Recruitment
- South Africa
- Permanent
- Full-time
- Terraform; Python 3x; Py Spark
- Boto3; ETL
- Docker; Linux / Unix; Big Data; Powershell / Bash
- Basic experience/understanding of AWS Components (in order of importance):
- Trino Distributed SQL queries.
- Glue (ETL Scripting)
- CloudWatch; SNS
- Athena; S3
- Kinesis Streams (Kinesis, Kinesis Firehose)
- Lambda; DynamoDB
- Step Function; Param Store
- Demonstrate expertise in data modelling Oracle SQL
- Exceptional analytical skills analysing large and complex data sets
- Perform thorough testing and data validation to ensure the accuracy of data transformations
- Strong written and verbal communication skills, with precise documentation
- Self-driven team player with ability to work independently and multi-task
- Experience building data pipeline using AWS Glue or Data Pipeline, or similar platforms
- Experience preparing specifications from which programs will be written, designed, coded, tested and debugged
- Strong organizational skills. Experience in working with Enterprise Collaboration tools such as Confluence, JIRA etc
- Experience developing technical documentation and artefacts
- Experience working with Data Quality Tools such as Great Expectations
Job Mail