Java Developer (Web Scraping Specialist)

Mid Level Java Developer - Web Scraping Specialism Norwich or London based Hybrid 2x a week in office Eames Consulting are partnered with a leading Legal-Tech firm offering innovative and smart IP legal management solutions utilising strategic analysis, real-time data collection and processing whilst harnessing the use of powerful cutting edge AI technology. They are seeking a talented and motivated Mid-Level Java Developer with a specialization in web scraping to join the development team. The ideal candidate will have a strong background in Java programming and extensive experience in web scraping techniques. You will be responsible for designing, implementing, and maintaining web scraping solutions to gather data from various online sources, ensuring data accuracy and reliability. Key Responsibilities: Develop and maintain web scraping applications using Java and related technologies. Design and implement efficient and scalable web scraping scripts and tools to extract data from various websites and APIs. Ensure data accuracy, integrity, and consistency across all scraped data. Collaborate with cross-functional teams, including data analysts, product managers, and other developers, to understand data requirements and deliver solutions. Optimize and improve existing web scraping solutions to enhance performance and reduce latency. Troubleshoot and resolve issues related to web scraping, such as changes in website structures, CAPTCHAs, and rate limits. Maintain documentation for web scraping processes, tools, and applications. Stay updated with the latest web scraping techniques, tools, and best practices. Ensure compliance with legal and ethical standards related to web scraping and data collection. Required Skills and Qualifications: Bachelor’s degree in Computer Science, Engineering, or a related field, or equivalent practical experience. 3 years of experience in Java development. 2-4 years of proven experience with web scraping using Java and related libraries/frameworks such as Jsoup, Selenium, and Playwright. Familiarity with version control systems, particularly Git. Strong problem-solving skills and attention to detail. Excellent communication and collaboration skills. Preferred Qualifications: Experience with additional programming languages and tools used in web scraping, such as JavaScript (Node.js, Puppeteer). Knowledge of AWS cloud platforms and services. Knowledge of data storage and processing (e.g., databases, JSON, XML). Experience with RESTful APIs and data integration.