Lead Data Engineer

Lead Data Engineer London, remote, hybrid Up to £90,000 per annum Bonus An excellent opportunity has arisen for an experienced and engaging Lead Data Engineer, to join a well-known organisation within the legal/tech sector. The successful applicant will join a well established team as the go-to Data Lead. They will drive performance, share expertise, and inspire the team to excel. They will manage a skilled team of data engineers, fostering a culture of best practices and continuous improvement. A good balance of soft and hard skills are required, as the role is 50% Leadership focussed and 50% hands on/technical. Main duties: Lead a team of data engineers to effectively create, optimise and maintain automated systems and processes across a given project(s) or technical domain. Coordinate engineering resources ensuring adherence to standards and effective delivery. Provide mentorship and guidance where required. Write clean and testable code using SQL and Python scripting languages, to enable our customer data products and business applications Build and manage data pipelines and notebooks, deploying code in a structured, trackable and safe manner Effectively create, optimise and maintain automated systems and processes across a given project(s) or technical domain Data Analyse, profile and plan work, aligned with project priorities Perform reviews of code, refactoring where necessary Deploy code in a structured, trackable and safe manner Document your data developments and operational procedures Ensure adherence to data/software delivery standards and effective delivery. Help monitor, troubleshoot and resolve production data issues when they occur Contribute to the continuous improvement of the team Required skills: Proven experience within a Lead Data Engineering role Excellent understanding of Databricks and Pyspark Strong knowledge of Azure Cloud Services Excellent understanding of SQL Good exposure to Azure Data Lake technologies such as ADF, HDFS and Synapse Good knowledge of Data Governance, Data Catalog, Master Data Management Excellent communication and stakeholder management skills Experience within a media, publishing, research, or a similar consumer focused industry is desirable but not essential. This represents the chance to drive your own technical and professional development within a highly innovative and growth focussed environment. This role is based in London, but can be worked as a hybrid model with 2 office days per week as the preference. If you are interested, please apply for full details.