Job DescriptionSenior Data Engineer - London, 2x Weekly - £65,000-£70,000
Our client is seeking a Senior Data Engineer to join their growing team in London. In this critical role, you will lead the design, development, and optimization of data pipelines and systems, with a strong focus on Snowflake and Databricks platforms. Your work will involve creating robust ETL processes using Python, enabling the organization to leverage its data more effectively. A background in AI/ML is highly advantageous, as the company is looking to integrate advanced analytics into their data operations.
What You'll Do
- Design, build, and optimise data pipelines using Snowflake and Databricks to support the company’s data infrastructure.
- Develop ETL processes in Python to automate the ingestion, transformation, and integration of data from various sources.
- Collaborate with data scientists and analysts to implement AI/ML models into the data architecture, enhancing the company’s analytical capabilities.
- Work with cross-functional teams to gather data requirements and translate them into scalable, efficient solutions.
- Ensure data quality, reliability, and performance across all data systems.
- Continuously assess and improve existing data processes to enhance efficiency and scalability.
- Stay up to date with emerging technologies and best practices in data engineering, particularly in Snowflake, Databricks, and AI/ML.
About You
- Extensive experience in data engineering with a strong focus on Snowflake and Databricks.
- Proficient in Python, with a proven track record of developing and maintaining ETL processes.
- Solid understanding of data architecture and best practices for building scalable, high-performance data systems.
- Experience with AI/ML technologies and a passion for integrating advanced analytics into data operations.
- Strong problem-solving skills and the ability to work independently in a fast-paced environment.
- Excellent communication skills, with the ability to convey complex technical concepts to both technical and non-technical stakeholders.
- A collaborative team player with experience working across multiple departments to achieve common goals.
Bonus Points If You Have
- Hands-on experience with AI/ML frameworks and integrating machine learning models into data pipelines.
- Familiarity with additional cloud data platforms or tools.
- Experience in a senior or lead role, mentoring junior engineers and guiding technical projects.