Big Data Specialist

Big data engineer, Day Rate Contract, Belfast (hybrid), up to £640 p/d We are currently working with a global financial institution to recruit a Big Data engineer join their dynamic Data Strategy team, dedicated to meeting the evolving business, analytical, and regulatory needs of their clients. This role will integrate diverse data sources, enabling industry-leading analytics, client reporting, regulatory compliance, and data science solutions. It will also enhance data quality, accuracy, and performance, ensuring compliance with regulatory guidelines. Key Responsibilities: Onboard new users and clients to the organisations Big Data platform. Collaborate with cross-functional teams to identify and prioritize data requirements, data quality issues, and performance bottlenecks. Set up build pipelines to automate the build and deployment process. Conduct code reviews, detect suboptimal queries, and address performance issues. Guide teams to follow industry-standard best practices. Design and develop scalable and fault-tolerant big data solutions on the Cloudera platform. Monitor and optimize the risk data platform for performance, scalability, and cost-effectiveness. To be considered for this role you will be required to possess the following Skills and Qualifications: 5 years of experience in big data technologies, with at least 3 years of experience in Apache Spark and Cloudera. Strong knowledge of big data technologies, including Hadoop, Hive, HBase, Kafka, and YARN. Excellent programming skills in Python and/or Scala. Strong analytical, problem-solving, and communication skills. Bachelor’s or master’s degree in computer science, Information Systems, or a related field. Ability to work independently and collaboratively in a fast-paced, agile environment. This role will be hybrid with 3 days working from the office in Belfast. Although the role is initially for a 11-month period there is a high possibility of extension. If you're interested in this role, please forward an up-to-date copy of your CV to Diarmuid.laveryhays.com or call me on 02890446905 . If this job isn't quite right for you, but you are looking for a new position, please contact us for a confidential discussion on your career.