Data Engineer

Swan iT Recruitment Ltd • Other • Cape Town, Western Cape, South Africa • $200 - $300 / year • 4h ago

Design and develop scalable data pipelines and ETL (Extract, Transform, Load) processes to collect, process, and integrate data from various sources into a centralized data warehouse or data lake.
Implementing data models, schemas, and database structures to organize and optimize data storage for efficient data retrieval, writing and analysis.
Collaborating with quantitative and analysts to understand their data requirements and provide them with the necessary infrastructure and tools for data exploration, analysis, and visualization.
Ensuring data quality and consistency by implementing data validation, cleaning, and transformation procedures.
Monitoring and maintaining the performance, availability, and security of data systems, including database servers, data warehouses, and data processing frameworks.
Troubleshooting and resolving data-related issues and performance bottlenecks in collaboration with the investment teams.
Evaluating and integrating new data technologies, tools, and frameworks to improve data infrastructure and processing capabilities.
Documenting data pipelines, workflows, and technical specifications to facilitate knowledge sharing and maintain system.
Keeping up-to-date with industry trends, best practices, and emerging technologies in the field of data engineering.

General:

Assist and collaborate on team wide projects.
Contribute to the analytics platform to know what is required from a Data Engineering perspective.
Assist and investigate ad-hoc data related queries.

REQUIRED EXPERIENCE

Up to 3 years’ experience with a specific focus in database management, data analysis and have produced ETL processes at scale are essential.
Basic understanding of financial instruments and markets.
Exceptional skill and experience in Python and SQL.

REQUIRED QUALIFICATIONS

University Post Graduate Degree (Computer Science/Information Systems/Maths/Stats/Business Science/Actuarial).
Strong programming skills in Python and SQL.

KEY COMPETENCIES

Excellent interpersonal skills, excellent communication skills oral and written.
Aptitude in decision-making and problem-solving.
Strong work ethic, self-motivated, driven and results oriented.
Ability to listen and respond to new ideas, input and diverse perspectives.
High levels of self-confidence, assertive as well as healthy levels of EQ.
Energetic problem-solver.
Structured work style, attention to detail and accuracy is of the utmost importance.

#J-18808-Ljbffr