We are searching high and low for our next Data Engineer to join our world-class team in Cape Town.
What will you be doing?
- You will be helping to build data-centric solutions for a Client's customers, applying engineering discipline to ensure high quality. Responsible for building data pipelines to bring together information from different source systems - to integrate, consolidate, cleanse and structure data.
- This isn’t a backroom role, and you can expect to spend time discussing design approaches and requirements with your colleagues and customers in addition to being engaged in development activities.
Experience:
- 5 - 10 years of experience
- Experience with varied types of data: tabular, graph, time-series, geospatial, image, etc.
- Practical knowledge of different types of databases – relational; document; graph; columnar; key-value.
- Large-scale data processing platforms, typically based on Hadoop/Spark.
- Business intelligence/analytics products or frameworks
- Knowledge of data processing capabilities in Azure; AWS and GCP (2 out of three)
- Knowledge of data integration technologies
- Knowledge of distributed computing and information security
- Ability to write good quality code in a JVM language like Java or Scala, incorporating disciplines such as Test Driven Development and structured version control; familiarity with Python a bonus.
#J-18808-Ljbffr