AWS Data Engineer

Datafin

  • Johannesburg, Gauteng
  • Permanent
  • Full-time
  • 28 days ago
ENVIRONMENT:A renowned company and leading in the field of Intelligent Process Automation (IPA) has a compelling opportunity for an AWS Data Engineer. The AWS Data Engineer is responsible for developing and maintaining the organizations data pipelines and systems on AWS. This role involves building data lakes, streaming pipelines, and batch processing systems that support analytics and business intelligence efforts.DUTIES:
  • Build and maintain scalable data pipelines using AWS Glue, EMR, Lambda, and Step Functions.
  • Develop and manage data lakes using S3 and Lake Formation.
  • Use Redshift and Athena for querying and analytical workloads.
  • Create ETL/ELT jobs and manage workflow orchestration.
  • Collaborate with data scientists, analysts, and other stakeholders.
  • Ensure data quality, governance, and compliance.
  • Monitor and optimize system performance and costs.
  • Integrate with third-party APIs and internal systems.
REQUIREMENTS:3+ years experience working with AWS cloud services.
  • Strong proficiency in:
  • AWS Glue
  • S3
  • Redshift
  • Lambda
  • Step Functions
  • Athena
  • Experience with streaming data using Kinesis or Kafka.
  • Strong SQL and Python skills.
  • Understanding of data governance and security in cloud environments.
  • Familiar with Infrastructure as Code (IaC) tools like CloudFormation or Terraform.
Qualifications:
  • Bachelors degree in Computer Science, Information Technology, or a related field.
  • AWS certifications preferred.

JobPlacements.com