Data Pipeline Engineer

Apply Now
Company
Hexegic
Job location
London, UK
Salary
Undisclosed
Posted
Hosted by
Adzuna

Job details

Hexegic is a leading technical consultancy providing agile multi-disciplinary teams to high performing organisations. The company promises exciting, engaging and rewarding projects for those that are keen to develop and build a successful career. The Role The Data Pipeline Engineers ensure that our customer work with updated and correct data in our data analytics tool. You are the first to respond to data health failures on key pipelines. You will be comfortable reading code to identify fixes and making changes. Core Responsibilities Maintain build schedules so that pipelines run effectively. Set up and maintaining health checks on different data pipelines Respond, Triage, and debug the data pipeline when broken. Reading code and writing code changes and/or modifying the monitoring set-up Knowing and understanding how to navigate the data pipelines and documentation. FollowingStandard Operating Procedures to contact other teams and data providers when data is incorrect or not received on time. Communicating outages with the end users of a data pipeline What We Value Comfortable reading and writing code in Python, Pyspark and Java. Basic understanding of Spark and interested in learning the basics of tuning Spark jobs. Data pipeline monitoring team members should be able to use and navigate pipeline development tools. Experience supporting data integration technologies. What we offer salary £50,000 to £60,000 25 days annual leave Personal development program £5,000 per employee per year
Apply Now
Other Jobs
Loading...
Get the freshest news and resources for developers, designers and digital creators in your inbox each week
Loading form
Start Free Trial
Connect
RSSFacebookInstagramTwitter (X)
This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
© 2000 - 2024 SitePoint Pty. Ltd.