Data Engineer Cape Town

Swan iT Recruitment Ltd • Other • Cape Town, Western Cape, South Africa • $200 - $300 / year • 1w ago

Design and develop scalable data pipelines and ETL (Extract, Transform, Load) processes to collect, process, and integrate data from various sources into a centralized data warehouse or data lake.
Implement data models, schemas, and database structures to organize and optimize data storage for efficient data retrieval, writing, and analysis.
Collaborate with quantitative analysts to understand their data requirements and provide them with the necessary infrastructure and tools for data exploration, analysis, and visualization.
Ensure data quality and consistency by implementing data validation, cleaning, and transformation procedures.
Monitor and maintain the performance, availability, and security of data systems, including database servers, data warehouses, and data processing frameworks.
Troubleshoot and resolve data-related issues and performance bottlenecks in collaboration with the investment teams.
Evaluate and integrate new data technologies, tools, and frameworks to improve data infrastructure and processing capabilities.
Document data pipelines, workflows, and technical specifications to facilitate knowledge sharing and maintain systems.
Keep up-to-date with industry trends, best practices, and emerging technologies in the field of data engineering.

General:

Assist and collaborate on team-wide projects.
Contribute to the analytics platform to know what is required from a Data Engineering perspective.
Assist and investigate ad-hoc data-related queries.

REQUIRED EXPERIENCE

Up to 3 years’ experience with a specific focus in database management, data analysis, and producing ETL processes at scale are essential.
Basic understanding of financial instruments and markets.
Exceptional skill and experience in Python and SQL.

REQUIRED QUALIFICATIONS

University Post Graduate Degree (Computer Science/Information Systems/Maths/Stats/Business Science/Actuarial).
Strong programming skills in Python and SQL.

KEY COMPETENCIES

Excellent interpersonal skills and communication skills, both oral and written.
Aptitude in decision-making and problem-solving.
Strong work ethic, self-motivated, driven, and results-oriented.
Ability to listen and respond to new ideas, input, and diverse perspectives.
High levels of self-confidence, assertive, as well as healthy levels of EQ.
Energetic problem-solver.
Structured work style, with attention to detail and accuracy being of utmost importance.

#J-18808-Ljbffr