AWS Cloud Data Engineer

Sandton, Johannesburg
Permanent
Full-time

6 days ago

Our client in the banking industry is looking for an AWS Cloud Data Engineer to join their team!The ideal candidate must have strong expertise in AWS data services, data pipeline development and modern data engineering practices, with the ability to support both batch and real-time processing requirements.Responsibilities:

Design, develop, and optimise ETL/ELT pipelines to ingest, transform, and store structured and unstructured data.
Build and manage data lakes and warehouses using AWS services (e.g., S3, Redshift, Athena, Glue).
Orchestrate and automate workflows with tools such as Step Functions, Airflow, or AWS Managed Workflows.
Work with real-time data streams using AWS Kinesis, MSK, or Kafka.
Implement data modelling, schema design, and lifecycle management.
Apply best practices in security, compliance, and data governance.
Monitor, troubleshoot, and optimise data pipelines for performance and cost efficiency.
Collaborate with Data Scientists, Analysts, and Business stakeholders to deliver reliable and high-quality data solutions.
Contribute to DevOps practices, including CI/CD for data pipelines and infrastructure-as-code (Terraform / CloudFormation).

Key Skills & ExperienceTechnical Expertise:

Strong hands-on experience with AWS services such as S3, Glue, Athena, Redshift, Lambda, EMR, Kinesis, RDS, IAM.
Proficiency in SQL and one or more programming languages (Python, Scala, or Java).
Experience with data modelling, schema design, and dimensional modelling
Experience with orchestration tools (Airflow, Step Functions, Luigi) for workflow management.
Familiarity with infrastructure as code (Terraform, CloudFormation).
Understanding of DevOps practices and CI/CD for data pipelines.
Knowledge of data governance, security, and compliance frameworks.

Nice-to-Have:

Experience with Snowflake, Databricks, or BigQuery.
Familiarity with containerisation (Docker, Kubernetes, ECS).
Exposure to MLOps and machine learning data pipelines.

Qualifications:

Bachelor's degree in Computer Science, Engineering, Information Systems, or related field (or equivalent experience).
AWS Certified Data Engineer - Associate (preferred). Candidates with strong AWS data engineering experience and working toward certification will also be considered.
Additional AWS certifications such as Solutions Architect - Associate/Professional or Data Analytics - Specialty are advantageous.
3-7 years of experience in Data Engineering, with at least 3+ years of hands-on AWS experience.

Praesignis

Apply Now