A position has become available for a Data Engineer - MS Fabric to join our dynamic team.
The purpose of the Data Engineer is to design, develop, and maintain cutting-edge data architecture and infrastructure for our business intelligence and analytics needs. You will create robust data models, develop seamless ETL processes, and ensure data quality using the Microsoft Fabric technology stack. In collaboration with data analysts and scientists you will deliver innovative BI solutions, integrate data from multiple sources, and drive impactful projects.
KEY PERFORMANCE AREAS
- Designing and implementing data models and data structures to support BI and analytics applications.
- Developing and maintaining ETL (Extract, Transform, Load) processes to integrate data from various sources.
- Ensuring data quality, accuracy, and consistency.
- Collaborating with data analysts, data scientists, and other stakeholders to understand their data needs and provide solutions.
- Designs and builds end-to-end BI solutions that will extract data from multiple systems.
- Develops proof-of-concept prototypes with fast iteration and experimentation.
- Works on projects to integrate data from various internal systems and cloud platforms, including work on all stages of the project through analysis, planning, testing, and release phases.
- Develops and maintains design documentation, test cases, performance and monitoring and performance evaluation.
- Coordinates, supports, and tests for regular maintenance routines - service pack upgrades, storage migration, site switches etc.
- Works closely with business customers, Business Analysts, and team members to understand the business requirements that drive the analysis and design of quality technical solutions.
- Any other ad hoc duties as required by management.
- Bachelor’s Degree in Computer Science, Data & Analytics Management, Supply Chain, Information Services, or related discipline.
- At least 5 years' experience within a data engineering environment.
- Proficiency in SQL and database design.
- Experience with ETL tools and processes.
- Familiarity with BI and analytics tools and platforms.
- Extensive Knowledge of data warehousing and data modelling concepts.
- Strong understanding of Business Intelligence and Data Warehousing concepts.
- Experience with Microsoft Fabric.
- Creating Data Flows and Pipelines to manage data movement.
- Experience with Python/pySpark specifically for data management.
- Experience working with and co-ordinating multi-business stakeholders and business owners in a retail environment.
The ideal applicant will satisfy the following skills requirements: - A high degree of confidentiality, emotional maturity, ethical values and integrity.
- Must have a high stress tolerance and the ability to work efficiently under pressure.
- Excellent communication, presentation, and interpersonal skills, to interface effectively with all levels of colleagues and with external customers in a team orientated manner.
- An innovative thinker and ability to solve complex problems.
- Must be collaborative, influential, and rational.
- Precise planning and excellent organisational/administration skills.
- Exceptional accuracy and extreme attention to detail.
- Quality orientated and self-driven to achieve result.
Kindly note: All applications are to be submitted through the Careers Site and Pnet. Please refrain from calling the Distribution Centre (DC) or emailing applications directly. “Your application and all personal information provided herein is protected under the Protection of Personal Information Act (4 of 2013), hereinafter referred to as the “Act”.
- The SPAR Group LTD, with its head offices at 22 Chancery Lane in Pinetown, is collecting this information to enable us to facilitate your application and /or assess your suitability for the advertised position. This information will be used for this purpose only and disposed of thereafter, unless you consent to the information being retained for marketing purposes.
- Where shortlisted, your information will be retained for a period of 3 months and disposed of immediately thereafter if you are unsuccessful in your application. Where employment is offered, it will be retained as part of your employee portfolio and secured accordingly.
- This information is given to us, by you, voluntarily and of your own free will.
- If you do not wish to provide us with this information, are unable to do so, or object to it being used, it will result in the disqualification of your application.
- In the course of the recruitment process, and for matters related to your application only, we may share your information with third parties.
- You have the right to access this information while in our possession and make corrections if necessary.
- You have the right to lodge a complaint via email with the office of the Information Regulator, at , if you are unhappy with the manner in which we deal with your information.
By submitting your application, you hereby declare your understanding of the aforementioned information and consent to the processing of your information in accordance with the Act, as well as the processing of any further personal information requested by us in the future including but not limited to, banking details, criminal history and credit reports /financial history information.” #J-18808-Ljbffr
