Python Web Scraper (On-site)

Title: Python Web Scraper

Job Description:

We are looking for a skilled and experienced Python Scraper Expert to join our team. The ideal candidate will have a strong background in web scraping, data extraction, and automation, using Python. You will play a critical role in gathering and analyzing data from various web sources to support our platform's growing needs.

Responsibilities:

Develop and maintain web scrapers to collect data from multiple sources.

Implement and optimize data extraction processes to ensure efficiency and accuracy.

Monitor scraping jobs to ensure timely and accurate data collection.

Troubleshoot and resolve issues related to web scraping and data extraction.

Collaborate with the development team to integrate collected data into our platform.

Ensure compliance with legal and ethical standards for web scraping.

Stay updated with the latest web scraping techniques, tools, and best practices.

Document processes and create detailed reports on data extraction activities.

Requirements:

Proven experience in web scraping and data extraction using Python.

Must have experience with YAML/YML files

Proficiency with web scraping libraries and frameworks such as BeautifulSoup, Scrapy, Selenium, Playwright etc.

Strong understanding of HTML, CSS, and JavaScript.

Experience with handling and processing large datasets.

Familiarity with databases and data storage solutions (SQL, NoSQL, etc.).

Knowledge of data cleaning and preprocessing techniques.

Ability to write clean, maintainable, and efficient code.

Excellent problem-solving skills and attention to detail.

Strong communication and collaboration skills.

Ability to work independently and manage multiple tasks simultaneously.

Preferred Qualifications:

Understanding of API interactions and data integration.

Experience with cloud services such as AWS, Azure, or GCP.

Familiarity with version control systems like Git.

Experience 2-3 Years