Data Engineer

Apply Now
Company
Complexio
Job location
UK, UK
Salary
Undisclosed
Posted
Hosted by
Adzuna
rezi_2024_august_sidebar

Job details

Complexio is Foundational AI. This works to automate business activities by ingesting whole company data – both structured and unstructured – and making sense of it. Using proprietary models and algorithms, Complexio forms a deep understanding of how humans are interacting and using it. Automation can then replicate and improve these actions independently. Complexio is a joint venture between Hafnia and Símbolo, in partnership with Marfin Management, C Transport Maritime, Trans Sea Transport and BW Epic Kosan. Key Responsibilities Collaborate with cross-functional teams to design and build scalable data solutions that support product innovations and business insights. Develop and maintain robust data pipelines that support complex data collection, ingestion, and transformation processes. ‍ Work closely with R&D within data science and AI to provide data. Design and implement mechanisms for data validation, quality, and reliability to ensure the accuracy and trustworthiness of data sources. Diagnose and resolve data-related issues to improve the performance and scalability of data systems. Contribute to creating data governance and security protocols to protect sensitive information. Requirements Ms.c degree in Computer Science, Engineering, or a related field. Minimum of 5 years of experience in data engineering or a related field. Proficient in and experience with relational databases (e.g., MySQL, PostgreSQL) as well as Strong experience with data pipeline and workflow management tools (e.g. sbt, Nifi). Familiarity with big data technologies, such as Spark. Especially when to use or not. Good understanding of streaming technologies (e.g., Kafka). Knowledge of cloud services and architecture (AWS, Azure, or GCP), particularly data storage and computing services. Experience with data integration, ETL processes, and familiarity with data warehousing solutions Proficiency in Python with a focus on data-centric programming. Experience with machine learning algorithms and data modelling techniques, including Large Language Models. Using and knowledge about Graph Databases (e.g. Neo4j) Proficiency in Python with a focus on data-centric programming Any questions please send details across to careerscomplexio.com.
Apply Now
Other Jobs
Loading...
Get the freshest news and resources for developers, designers and digital creators in your inbox each week
Loading form
Start Free Trial
Connect
RSSFacebookInstagramTwitter (X)
This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
© 2000 - 2024 SitePoint Pty. Ltd.