A technology and analytics driven consulting company empowering clients by solving real-world business challenges that deliver tangible value and count their core capabilities as spanning the disciplines of Data Science, Data Engineering and Software Engineering have an opening for an Azure Data Engineer to help develop best practices and drive improvements in data engineering across the business and across a wide range of industries such as mining, telcos, retail and financial services.
Responsibilities:
- Analyse and organise raw data
- Design data engineering solutions to meet business requirements
- Build scalable data pipelines that clean, transform and aggregate data from different sources using appropriate tools and technologies
- Collaborate with data scientists to prepare data sets for analytical modelling
- Identify ways to enhance data quality and reliability
- Manage technical delivery of projects
- Mentor junior data engineers
Qualifications and Experience:
- Graduate or Postgraduate degree in Computer Science, Information Technology, Statistics, Engineering or related technical field.
- 2-6 years of relational SQL database
- Solid understanding of Apache Spark as a distributed data processing framework
- Experience in designing, implementing and performance tuning solutions in Apache Spark
- Experience in complex data warehouse and data lake design
- Experience in building, optimizing and managing data pipelines for large and complex datasets
- Experience in Azure Storage / Data Lake, Azure SQL Database, Azure Data Factory, Azure Data bricks, Azure Synapse Analytics to implement data pipelines and analytical solutions
- Experience in Python would be beneficial
Reference Number for this position is NG59096 this is a Permanent position in Johannesburg offering a salary of R900k to 1.1mil CTC salary negotiable based on experience. E-mail Nokuthula on
