Web Scraping Developer

Job Description: Web Scraping Developer

Experience: 1 Year
Department: Data Solutions
Employment Type: Full-Time

Job Summary

We are looking for a motivated Web Scraping Developer with around 1 year of experience in Python programming and web data extraction. The candidate will be responsible for developing, maintaining, and troubleshooting web scraping scripts to collect accurate and reliable data from websites while meeting project requirements and delivery timelines.

Key Responsibilities

• Develop and maintain web scraping scripts using Python.
• Extract relevant data from websites based on business and project requirements.
• Work with libraries such as BeautifulSoup, Requests, Selenium, and Scrapy.
• Analyze website structures, HTML, CSS selectors, and XPath to identify relevant data elements.
• Handle pagination, cookies, sessions, headers, and basic API requests.
• Identify and resolve scraping errors, data inconsistencies, and website changes.
• Perform data validation and quality checks to ensure accuracy and completeness.
• Maintain existing scripts and troubleshoot issues in scheduled scraping jobs.
• Coordinate with team leads and QA teams to meet project requirements and delivery deadlines.
• Document scripts, issues, and process updates.

Required Skills

• Basic to intermediate knowledge of Python programming.
• Understanding of HTML, CSS, XPath, and web page structures.
• Hands-on experience with BeautifulSoup and Requests.
• Basic knowledge of Selenium or Scrapy.
• Understanding of JSON, APIs, HTTP requests, and response codes.
• Familiarity with SQL and databases is an advantage.
• Basic knowledge of Git or version control is preferred.
• Good analytical, debugging, and problem-solving skills.
• Willingness to learn new tools, technologies, and website-specific scraping techniques.

Educational Qualification

• Bachelors degree in Computer Science, IT, or a related field is preferred.
• Relevant practical projects or internship experience may also be considered.

Experience

• Approximately 1 year of hands-on experience in web scraping, data extraction, or Python development.
• Candidates with strong practical knowledge and relevant projects may also be considered.

Preferred Attributes

• Attention to detail and commitment to data quality.
• Ability to work collaboratively in a team.
• Good communication and time-management skills.
• Proactive approach to learning and resolving technical challenges.

Key Performance Expectations

• Timely completion of assigned scraping tasks.
• Accuracy and completeness of extracted data.
• Effective troubleshooting and resolution of scraping issues.
• Adherence to coding standards and documentation practices.
• Continuous improvement in script reliability and execution efficiency.