AWS Data Engineer
Deka Minas
- Johannesburg, Gauteng
- Temporary
- Full-time
- Develop data models for extracting information from diverse sources and storing it in a usable format.
- Lead the design, implementation, and successful delivery of large-scale data solutions involving significant data volumes.
- Utilize strong SQL skills and expertise in ETL processes and data modeling.
- Ingest data into AWS S3, perform ETL into RDS or Redshift, and use AWS Lambda (C# or Python) for event-driven data transformations.
- Design and implement security measures to safeguard data against unauthorized access or misuse.
- Maintain data integrity through the implementation of backup and recovery procedures.
- Automate migration processes in AWS from development to production environments.
- Deliver actionable data content to support business decision-making.
- Collaborate on all aspects of data engineering, including planning, estimation, analysis, architecture design, and implementation.
- Design complex data solutions spanning batch, streaming, and event-driven architectures across cloud, on-premises, and hybrid environments.
- Optimize cloud workloads for cost, scalability, availability, governance, and compliance.Requirements:
- 5+ years of Python/C# development experience.
- 3+ years of AWS data engineering experience.
- Global Markets experience preferred.
- Proficiency in creating data products and conducting data analysis.
- Experience with AWS Glue Jobs using PySpark or AWS Glue Spark.
- Strong SQL skills and proficiency in C# or Python programming.
- Expert knowledge of data engineering packages and libraries.
- AWS technical certifications preferred.
- Experience with microservices development using serverless AWS services.
- Familiarity with SQL Server, MySQL, and scripting/automation tools.
- Ability to troubleshoot data issues effectively and efficiently.
- Experience in SDLC delivery methodologies, including waterfall, hybrid, and Agile.
- Demonstrated experience delivering data solutions and pipelines on the AWS Cloud Platform.
- Understanding of data modeling, data structures, databases, and ETL processes.
- Experience delivering CI/CD and DevOps capabilities in a data environment.Benefits:
- Opportunity to work with cutting-edge technology in the financial sector.
- Dynamic and collaborative work environment with opportunities for professional growth and development.
- Exposure to global markets and leading financial institutions.
- Work-life balance initiatives and flexible work arrangements.Application Process:
If you possess the skills and experience required for this exciting opportunity and are passionate about driving innovation in the financial sector, please submit your resume and cover letter detailing your relevant experience and qualifications.Please note that by submitting your personal information to Deka Minas you free-willingly issue the business consent to make use of such data for the specific purpose of securing you either permanent or temporary employment. Our business makes use of a POPIA compliant database and you have the right to access, right to correction and right to deletion of your personal information.