Senior Data Engineer

Senior Data Engineer Wiltshire - 3 days in office £65,000 About The Company The company operates in both B2B and D2C markets, providing food solutions to institutions and individuals. With over 30 years of experience and a presence in 400 markets, it leverages data-driven insights, forensic analytics, and predictive modelling to enhance business performance. The Role The team is responsible for making data reliable, consistent, persistent, and available for analysts through self-service platforms such as Tableau, Power BI, and SSRS. Within the team, this role will focus on data infrastructure management to ensure system reliability and availability. The day to day will include: Ensuring system availability and reliability to support business operations. Leading internal development projects to enhance infrastructure and free up resources for strategic improvements. Analysing data to understand differences, ensuring accuracy, and improving data validation processes. Handling data quality and migration projects to enhance system performance and integrity. Supporting the deployment of machine learning models using Databricks and PySpark. Managing and optimising cross-functional ETL processes across 80 databases daily. Working within a secure private cloud environment that includes Azure, SQL 2016, and SQL Server. About You The ideal candidate will have: Hands-on experience working across multiple platforms, particularly SSIS and SSRS, to manage data integration and reporting. Proven DBA expertise, including database optimisation, indexing strategies, and troubleshooting complex data environments. A background in managing and working within complex data infrastructures, ensuring reliability and efficiency. Proficiency in cloud-based data tools, including Databricks, Data Factory, and Fabric, to streamline data engineering processes. Advanced skills in SQL, Python, and MongoDB, enabling efficient querying, scripting, and automation. This role is ideal for someone passionate about data infrastructure, keen to work in a dynamic, data-rich environment, and eager to contribute to a business that values innovation and efficiency in its data operations.