A diversified financial services group, listed on the Johannesburg Stock Exchange and is one of South Africas leading direct distributors of financial service products. Has an opening for an AWS data engineer you will be responsible for various tasks related to the ingestion, management, serving of data and working with large data sources.
Responsibilities:
- Designing and implementing optimal data models projects.
- Design data across the full range from fast/clean ETL streams through to automation.
- Identifying key performance improvement opportunities.
- Creation of data validation models and ensuring data quality.
- Working with clients and other team members to identify key data requirements.
- Writing appropriate algorithms to interpret and serve the relevant data.
- Build robust data solutions.
- An ambition to design data-driven applications with an ability to assess trade-offs in architectural decisions.
Qualifications and Experience:
- Degree or National Diploma
- An ambition to design data-driven applications with an ability to assess trade-offs in architectural decisions
- Fluency in reasoning about relational and non-relational databases
- Experience with distributed computing tools (Apache Spark, Hive, Kafka, etc)
- Advanced knowledge of SQL, PL\SQL (Oracle, Redshift, PostgreSQL).
- Ability to use big data technologies on AWS cloud services: Athena, Lambda, Cloud Formation Stack, EMR, Spark/Storm, Kafka/ElasticSearch.
The Reference Number for this position is NG59545 which is a Full-Time in Office position in Johannesburg offering a salary of R850k up to R950k per hour negotiable based on experience. E-mail Nokuthula