Flag job

Report

Technical lead - Python web scraping

Salary

₹12 - 20 LPA

Min Experience

5 years

Location

remote

JobType

full-time

About the job

Info This job is sourced from a job board

About the role

We are seeking an experienced Tech lead - Web Scraping Engineer to lead data extraction efforts for our enterprise clients. In this role, you will be tasked with creating and maintaining robust, large-scale scraping systems for gathering structured data. Skills Required: Exp- 5-10+year Proven work experience as web scraping engineer Proven team handling required Expert in Python and scraping libraries such as Scrapy and BeautifulSoup. Deep understanding of web scraping techniques and challenges (CAPTCHAs, anti-bot measures). Responsibilities: Develop and optimize custom web scraping tools and workflows. Lead a team of junior developers to improve data extraction systems. Integrate scraping systems with data storage solutions like SQL and NoSQL databases. Troubleshoot and resolve scraping challenges, including CAPTCHAs, rate limiting, and IP blocking. Provide technical guidance on scraping best practices and standards.

Skills

python
scrapy
beautifulsoup