Data Engineer

Crayon Technologies

  • Durban, KwaZulu-Natal
  • Permanent
  • Full-time
  • 11 days ago
How you'll roleAs the Data Architect, you'll collaborate closely with engineering, analytics, governance, and business teams to drive best practices across both on-premise and cloud environments (AWS, Azure). The ideal candidate will align data architecture strategies with business objectives, enabling advanced analytics, AI/ML initiatives, and seamless operational data use.What you'll do
  • Design and implement scalable, secure, and efficient enterprise data architecture aligned with business goals
  • Develop and maintain comprehensive data models (conceptual, logical, physical) that support business and analytical needs
  • Define and enforce data governance policies, standards, lineage, and metadata management practices
  • Drive integration across systems via ETL/ELT pipelines, APIs, and real-time streaming solutions
  • Optimize data storage and retrieval for structured andunstructured data across hybrid infrastructures
  • Collaborate with technical and business teams to enable data-driven decisionmaking
  • Ensure compliance with data privacy and protection regulations (e.g., GDPR, POPIA)
  • Evaluate emerging technologies to enhance scalability maintainability, and performance
  • Monitor and improve data quality, consistency, and system performance
  • Oversee and guide project lifecycles from inception to completion
  • Collaborate with cross-functional teams to ensure seamless project execution
  • Align project activities with business goals and objectives
  • Develop and maintain project schedules and budgets
  • Identify potential risks and develop mitigation strategies
What you'll need
  • Bachelors or Masters degree in Computer Science, Data Engineering, Information Systems, or a related discipline
  • Minimum 5 years of experience in data architecture, data modeling, or data engineering
  • Proven experience with both on-premise data platforms (e.g., Oracle DWH, OLAP) and cloud platforms (AWS, Azure, GCP)
  • Strong understanding of ETL/ELT processes, data integration, and real-time data streaming
  • Familiarity with data governance frameworks (e.g.,DAMA-DMBOK)
  • Expertise in RDBMS (Oracle, SQL Server, PostgreSQL) and modern cloud-native solutions (e.g., Redshift, Snowflake, BigQuery, DynamoDB)
  • Proficient in AWS services such as S3, Glue, Redshift, and Athena
  • Experience with API-based integration and event-driven architectures (Kafka, Kinesis, Pub/Sub)
  • Hands-on experience in data cataloguing, lineage, and metadata management
  • Knowledge of data security best practices including encryption, IAM, and compliance frameworks

Careers24

Similar Jobs

  • Kafka Engineer

    Network Recruitment

    • Durban, KwaZulu-Natal
    Requirements: Matric IT Degree or Diploma C# experience Java or Scala experience Proficient in Kafka Experience with cloud platforms (like AWS, Azure, or GCP) Proficie…
    • 17 hours ago
  • Process Support Engineer

    The HR Company

    • Durban, KwaZulu-Natal
    Key Functions Process Design & Development Develop, design, and modify processes to improve efficiency, quality, and safety. Create and maintain process flow diagrams (PFDs) a…
    • 1 day ago
  • Tooling Data Programmer

    MC Technology Staffing

    • Pinetown, KwaZulu-Natal
    Key Responsibility Program tools for cutting, punching, and shaping of metal sheets using Metacam software Prepare job cards and associated documents using Fabri-Trak Prepare …
    • 1 day ago