A technology and analytics driven consulting company empowering clients by solving real-world business challenges that deliver tangible value and count their core capabilities as spanning the disciplines of Data Science, Data Engineering and Software Engineering have an opening for a Senior Azure Data Engineer to help develop best practices and drive improvements in data engineering across the business and across a wide range of industries such as mining, telcos, retail and financial services.
Responsibilities:
- Analyse and organise raw data
- Design data engineering solutions to meet business requirements
- Build scalable data pipelines that clean, transform and aggregate data from different sources using appropriate tools and technologies
- Collaborate with data scientists to prepare data sets for analytical modelling
- Identify ways to enhance data quality and reliability
- Manage technical delivery of projects
- Mentor junior data engineers
Qualifications and Experience:
- Graduate or Postgraduate degree in Computer Science, Information Technology, Statistics, Engineering or related technical field.
- 2-6 years of relational SQL database
- Solid understanding of Apache Spark as a distributed data processing framework
- Experience in designing, implementing and performance tuning solutions in Apache Spark
- Experience in complex data warehouse and data lake design
- Experience in building, optimizing and managing data pipelines for large and complex datasets
- Experience in Azure Storage / Data Lake, Azure SQL Database, Azure Data Factory, Azure Data bricks, Azure Synapse Analytics to implement data pipelines and analytical solutions
- Experience in Python would be beneficial
Reference Number for this position is NG59096 this is a Permanent position in Johannesburg offering a salary of R900k to 1.1mil CTC salary negotiable based on experience. E-mail Nokuthula on
