Cloud Data Engineer (Hadoop / Spark / Bigdata)

Apply Now
Company
GIOS Technology
Job location
West Midlands, UK
Salary
Undisclosed
Posted
Hosted by
Adzuna

Job details

We are hiring for Cloud Data Engineer (Hadoop / Spark / Bigdata) Location : Hybrid - 2 days per week in Solihull Office Design, develop, and optimize data pipelines using Scala, Spark, and cloud technologies. Integrate data from diverse sources into the Raw Layer of DATAHUB. Model data and develop efficient data pipelines to enrich and transform large volumes of data. Implement data transformation and quality control processes to ensure data consistency and accuracy. Strong programming skills in Scala, Python, and SQL. Experience with data processing frameworks like Apache Spark. Knowledge of cloud platforms (AWS, GCP) and cloud-native technologies. Familiarity with data warehousing and data modeling concepts. Experience with data quality tools and techniques. Understanding of CI/CD pipelines and DevOps practices. Set up CI/CD pipelines for automated deployment and testing. Key Skills : Cloud Data Engineer (Hadoop / Spark / Bigdata)
Apply Now
Other Jobs
Loading...
Get the freshest news and resources for developers, designers and digital creators in your inbox each week
Loading form
Start Free Trial
Connect
RSSFacebookInstagramTwitter (X)
This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
© 2000 - 2024 SitePoint Pty. Ltd.