Senior Data Engineer

Senior Data Engineer - London, 2x Weekly - £65,000-£70,000 Our client is seeking a Senior Data Engineer to join their growing team in London. In this critical role, you will lead the design, development, and optimization of data pipelines and systems, with a strong focus on Snowflake and Databricks platforms. Your work will involve creating robust ETL processes using Python, enabling the organization to leverage its data more effectively. A background in AI/ML is highly advantageous, as the company is looking to integrate advanced analytics into their data operations. What You'll Do Design, build, and optimise data pipelines using Snowflake and Databricks to support the company’s data infrastructure. Develop ETL processes in Python to automate the ingestion, transformation, and integration of data from various sources. Collaborate with data scientists and analysts to implement AI/ML models into the data architecture, enhancing the company’s analytical capabilities. Work with cross-functional teams to gather data requirements and translate them into scalable, efficient solutions. Ensure data quality, reliability, and performance across all data systems. Continuously assess and improve existing data processes to enhance efficiency and scalability. Stay up to date with emerging technologies and best practices in data engineering, particularly in Snowflake, Databricks, and AI/ML. About You Extensive experience in data engineering with a strong focus on Snowflake and Databricks. Proficient in Python, with a proven track record of developing and maintaining ETL processes. Solid understanding of data architecture and best practices for building scalable, high-performance data systems. Experience with AI/ML technologies and a passion for integrating advanced analytics into data operations. Strong problem-solving skills and the ability to work independently in a fast-paced environment. Excellent communication skills, with the ability to convey complex technical concepts to both technical and non-technical stakeholders. A collaborative team player with experience working across multiple departments to achieve common goals. Bonus Points If You Have Hands-on experience with AI/ML frameworks and integrating machine learning models into data pipelines. Familiarity with additional cloud data platforms or tools. Experience in a senior or lead role, mentoring junior engineers and guiding technical projects.