Data Engineer

TravelLab Global AB • Other • Cape Town, Western Cape, South Africa • $200 - $300 / year • 6h ago

Our Travelstart team is looking for a talented Data Engineer to join us. This role will focus on developing and maintaining robust data infrastructure on the Google Cloud Platform (GCP) to support data-driven decision-making. This individual will be responsible for designing, implementing, and managing data pipelines, optimizing data performance, and ensuring data integrity.

Key Responsibilities

Data Infrastructure Development: Develop and maintain scalable data infrastructure on GCP, including data lakes, data warehouses, and data pipelines.
Performance Optimization: Tune and optimize the performance of analytical systems to ensure efficient data processing and analysis.
Data Pipeline Development: Design, implement, and manage data pipelines to extract, transform, and load data from various sources into target systems.
Database Management: Oversee analytical databases on BigQuery, ensuring data integrity, performance, and security.
Data Solution Design: Design and implement scalable data solutions to meet the evolving needs of various stakeholders.
Data Integration: Integrate and manage data provided by third-party vendors and partners.
Data Quality: Troubleshoot and resolve data-related issues to improve data quality and accuracy.
Data Requests: Respond to internal and external data requests efficiently and accurately.
Data Analysis: Develop complex SQL queries for data analysis, reporting, and troubleshooting.
Data Visualization: Build and maintain visualized reports using advanced data visualization tools.

Qualifications

Bachelor's degree in Computer Science, Information Technology, or a related field, or 10+ years of relevant experience in data engineering or a related field.
Proficiency in at least one programming language, with a preference for Python and Java.
Experience with cloud platforms, particularly Google Cloud Platform (GCP).
Strong expertise in data pipeline tools such as Apache Beam, Apache Spark, etc.
Proven experience with BigQuery and traditional SQL databases.
Demonstrated experience in designing and managing data warehouses.
Advanced SQL skills, including the ability to write and optimize complex queries.
Familiarity with data visualization tools such as Tableau, Qlik, Looker Studio, etc.
Excellent problem-solving skills and the ability to troubleshoot data issues effectively.
Strong communication skills, with the ability to collaborate with cross-functional teams.

#J-18808-Ljbffr

Apply directly