Technical lead - Python web scraping

We are seeking an experienced Tech lead - Web Scraping Engineer to lead data extraction efforts for our enterprise clients. In this role, you will be tasked with creating and maintaining robust, large-scale scraping systems for gathering structured data. Skills Required: Exp- 5-10+year Proven work experience as web scraping engineer Proven team handling required Expert in Python and scraping libraries such as Scrapy and BeautifulSoup. Deep understanding of web scraping techniques and challenges (CAPTCHAs, anti-bot measures). Responsibilities: Develop and optimize custom web scraping tools and workflows. Lead a team of junior developers to improve data extraction systems. Integrate scraping systems with data storage solutions like SQL and NoSQL databases. Troubleshoot and resolve scraping challenges, including CAPTCHAs, rate limiting, and IP blocking. Provide technical guidance on scraping best practices and standards.