Data Engineer (Aws)

TOTAL Deutschland GmbH • Other • City of Johannesburg Metropolitan Municipality, Gauteng, South Africa • $200 - $300 / year • 6h ago

Domaine Systèmes d'Information

Type de contrat CDD

Expérience Minimum 3 ans

Accountabilities:

Facilitate the connection, ingestion and archiving of TMSA source data into the TotalEnergies Cloud in a safe, secured and structured manner.
Analyse and define data architecture requirements by evaluating business processes and existing data structures and applications.
Support the development of Digital projects within TMSA.
Support productionised Digital solutions within TMSA, including assisting with incident resolution and planning future enhancements.
Ensure all solutions developed are in compliance with TotalEnergies Company Rules, or otherwise assist in the development of new or modification of existing Company Rules.
For all solutions developed, work with IT to ensure compliance with TotalEnergies Security Rules and Guidelines.
Design, develop, and implement end-to-end data solutions (storage, integration, processing, access) in AWS or equivalent.
Architect and support the development of automated data pipelines (ETL, ELT) in conjunction with business stakeholders.
Propose architectures that consider cost/spend in Azure/AWS or equivalent and develop recommendations or plans to right-size data infrastructure.
Design and implement data models to document the data architecture in its AS-IS and TO-BE states.
Assist in the definition of a Cloud Data strategy, solutions and roadmaps, ensuring they meet both business and performance goals in line with the TotalEnergies IT strategy and Data Governance guidelines.
Identification of new digital techniques, tools or best practices and assist in integrating them into the Digital & Data department’s ways of working.

Functional Expertise:

Provide functional expertise and guidance around leveraging the capabilities of cloud platforms to business stakeholders.
Act as liaison between business key users and the IT Department - for investigating, analyzing, and implementing cloud-based solutions (including documenting, data mapping, analytical processing and source system modifications).

Solution Development:

Assist in the development of end-to-end solutions for new and existing digital projects.
Run proof of concepts and investigate opportunities for use of innovative cloud solutions.

Solution Support:

Support incident resolution on productionised digital solutions.
Responsible for ensuring the production services are optimally configured and aligned to best practices to protect production data.
Support the development of automated data pipelines (ETL, ELT) in conjunction with business stakeholders and IT teams.
Work in close collaboration with IT to define and develop the industrialised digital support process which will be managed and administered by IT.

Qualifications/Experience required

Required:

Ability to develop technical solutions and functional specifications based on business requirements.
Knowledge of leading technologies including:
- Enterprise data modelling
- Data ingestion and integration
- Data storage and security
- Data processing and distributed computing
- Software engineering principles and application architectures
- Hardware infrastructure and networking
Extensive experience working with relational databases, including database administration.
Proven production experience and best practice knowledge of cloud platforms, features, and capabilities (Microsoft Azure & AWS components).
Experience integrating cloud services to securely work with on-premise data sources.
Excellent interpersonal, communication skills, written and verbal combined with effective technical presentation skills.
Organised, methodical and able to multi-task whilst working under tight deadlines.

Preferred:

A thorough understanding of the Downstream industry and knowledge of Downstream companies' main strategic drivers.
Knowledge of multi-tier, high availability, cloud and on-premise data engineering solutions in a complex multi-site enterprise environment.
Experience of working within the Microsoft Azure/AWS tech stack.
Experience of working within a dynamic Agile based team.

Job dimensions

Responsible for the development and delivery of cloud-based data engineering solutions.
Provide support & guidance on data and technology subjects for the Digital development squads across the business.
Centre of Excellence for cloud development within TMSA.
Act as Chapter Lead for the Data Engineer to ensure best practice for data architecture is applied consistently across TMSA.

#J-18808-Ljbffr

Apply directly

Related Jobs

Business Analyst/Consultants

Premium personnel • Other • City of Johannesburg Metropolitan Municipality, Gauteng, South Africa • 24min ago

SKU-ZAWJO

24min ago

Apply

Junior business consultant/analysis

Premium personnel • Other • City of Johannesburg Metropolitan Municipality, Gauteng, South Africa • 24min ago

SKU-ZAWJO

24min ago

Apply

Specialist/Consultant HR Systems

Sasol • Other • City of Johannesburg Metropolitan Municipality, Gauteng, South Africa • $300 - $400 / year • 28min ago

SKU-ZAWJO

28min ago

Apply

Sustainability and Climate Change Consultant

PwC South Africa • Other • City of Johannesburg Metropolitan Municipality, Gauteng, South Africa • $300 - $400 / year • 29min ago

SKU-ZAWJO

29min ago

Apply

Business Analyst

DLK Group • Other • City of Johannesburg Metropolitan Municipality, Gauteng, South Africa • $200 - $300 / year • 29min ago

SKU-ZAWJO

29min ago

Apply

Human Resources Analyst -12 months Fixed-Term Contract

Massmart • Other • City of Johannesburg Metropolitan Municipality, Gauteng, South Africa • $200 - $300 / year • 29min ago

SKU-ZAWJO

29min ago

Apply

Retail Sales Associate - South Hills Village

City of Iqaluit • Other • City of Johannesburg Metropolitan Municipality, Gauteng, South Africa • $50 - $200 / year • 29min ago

SKU-ZAWJO

29min ago

Apply

Superintendent (Engineering) LCR

Glencore International AG • Other • City of Johannesburg Metropolitan Municipality, Gauteng, South Africa • $200 - $300 / year • 29min ago

SKU-ZAWJO

29min ago

Apply

Marketing Manager

Spartan SME Finance • Other • City of Johannesburg Metropolitan Municipality, Gauteng, South Africa • $200 - $300 / year • 30min ago

SKU-ZAWJO

30min ago

Apply

Chief Audit Executive

ATNS SOC Limited • Other • City of Johannesburg Metropolitan Municipality, Gauteng, South Africa • $600 - $750 / year • 30min ago

SKU-ZAWJO

30min ago

Apply