Data Engineer
NTT Corporation
- Johannesburg, Gauteng
- Permanent
- Full-time
- Create data models in a structured data format to enable analysis thereof
- Design and develop scalable extract, transform and loading (ETL) packages from the business source systems and the development of ETL routines to populate data from sources, Participate in the transformation of object and data models into appropriate database schemas within design constraints. Interpret installation standards to meet project needs and produce database components as required
- Create test scenarios and be responsible for participating in thorough testing and validation to support the accuracy of data transformations
- Accountable for running data migrations across different databases and applications, e.g. MS Dynamics, Oracle, SAP and other ERP systems
- Work across multiple IT and business teams to define and implement data table structures and data models based on requirements
- Accountable for analysis, and development of ETL and migration documentation
- Collaborate with various stakeholders to evaluate potential data requirements
- Accountable for the definition and management of scoping, requirements, definition, and prioritisation activities for small-scale changes and assist with more complex change initiatives
- Collaborate with various stakeholders, contributing to the recommendation of improvements in automated and non-automated components of the data tables, data queries and data models
- Seasoned in the definition and management of scoping requirements, definition and prioritisation activities
- Good understanding of database concepts, object and data modelling techniques and design principles and conceptual knowledge of building and maintaining physical and logical data models
- Specialist either in Microsoft Azure Data Factory, SQL Analysis Server, SAP Data Services, SAP BTP
- Good understanding of data architecture landscape between physical and logical data models
- Analytical mind and business acumen
- Problem-solving aptitude
- Bachelor's degree with 3 years related professional experience
- Relevant certifications, e.g., SAP, Microsoft Azure
- Certified Data Engineer, Certified Professional
- Seasoned experience as a data engineering, data mining within a fast-paced environment
- Proficient in building modern data analytics solutions that delivers insights from large and complex data sets with multi-terabyte scale
- Seasoned experience with architecture and design of secure, highly available and scalable systems.
- Proficient in automation, scripting and proven examples of successful implementation
- Proficient in scripts using scripting language (Perl, bash, Shell Scripting, Python, etc.)
- Seasoned experience with big data tools like Hadoop, Cassandra, Storm etc
- Seasoned experience in any applicable language, preferably .NET
- Proficient in working with SAP, SQL, MySQL databases and Microsoft SQL
- Seasoned experience working with data sets and ordering data through MS Excel functions, e.g. macros, pivots
- Seasoned experience working in internet technologies, e.g., SaaS