Data Team Lead

Lead Data Engineer - London, Hybrid - £80,000 - £100,000 DOE Our client is offering an exciting opportunity for an experienced Data Engineer to join their Engineering team within the Digital & Product Department. In this pivotal role, you will lead a team of data engineers in designing and building scalable, repeatable data pipelines. This hands-on position will require you to engage in discussions about requirements, design effective solutions, and produce code to automate the ingestion, cleansing, and transformation of data to achieve the desired target format. Duties & Responsibilities Design, build, and develop ETL and data integration solutions using a variety of technologies and data sources. Manage and continuously update the Data Engineering Architecture to meet evolving needs. Analyse and organize raw data from diverse sources, ensuring quality and reliability. Identify, design, and implement internal process improvements, such as automating manual processes and optimizing data delivery. Work with cloud-based infrastructure (Azure) to host data solutions and applications. Collaborate with architects, data analysts, and data scientists to help meet business objectives. Skills Required Proven experience as a Data Engineer with a strong background in ETL/ELT process development and maintenance within a medallion architecture. Extensive experience in Data Modelling within a cloud-based data platform. Proficiency in SQL Server and relational databases. Extensive experience of Azure data engineering stack, including Azure Synapse and Azure Data Lake is a MUST Programming expertise in Python, PySpark, and T-SQL. Familiarity with the broader Azure Data Solutions, such as Azure ML Studio. Experience with Azure DevOps and a solid understanding of CI/CD processes. Strong analytical skills for working with both structured and unstructured datasets. Excellent written and verbal communication skills. Experience supporting and collaborating with cross-functional teams in a dynamic environment. Must be a British Citizen Join our client to lead and innovate within their data engineering initiatives in London. Apply now to become their next Data Engineer