- Design, develop, and maintain robust web scraping scripts and applications to extract data from various online sources.
- Perform data extraction from multiple websites, effectively handling both static and dynamic content.
- Clean, validate, and structure large volumes of scraped data to ensure accuracy for further analysis.
- Monitor scraping pipelines for data quality, troubleshoot scraping failures, and implement solutions to maintain effectiveness.
- Collaborate with team members to define data requirements and deliverables, ensuring alignment with project goals.
- Document scraping processes and maintain code for scalability and reusability in future projects.
Requirements
- Have proven experience in building and maintaining web scrapers using tools such as Python, Scrapy, Selenium, or similar technologies.
- Possess a strong understanding of HTML, CSS, JavaScript, and web protocols.
- Have expertise in handling APIs, RESTful interfaces, and parsing JSON/XML data.
- Demonstrate proficiency with data cleaning, manipulation, and storage using relational or NoSQL databases.
- Have knowledge of web security concepts and best practices for ethical scraping.
Application Process
- Easy Apply on LinkedIn
- Check email for next steps
- Participate in resume evaluation & interview stage