Volody - Web Scraping Engineer - Python/Scrapy

We Are Seeking An Experienced Web Scraping Engineer With Deep Expertise In Scrapy To Develop, Maintain, And Optimize Web Crawlers. The Ideal Candidate Will Have a Strong Background In Extracting, Processing, And Managing Large-scale Web Data

• Write and maintain web scraping scripts using Python Optimize custom web scraping tools and workflows.
• Familiarity with Python and web scraping frameworks (Scrapy, Selenium, BeautifulSoup, Requests, Playwright).
• Troubleshoot and resolve scraping challenges, including CAPTCHAs, rate limiting, and IP blocking.
• Experience with proxy management (Rotating IPs, VPNs, Residential proxies, etc.)
• Handle dynamic content using headless browsers and solve CAPTCHAs & IP bans.
• Collaborate with senior developers to improve code quality and efficiency.
  
  

Skills Required

• Python and scraping libraries such as Scrapy and BeautifulSoup
• Experience with proxy management, CAPTCHA bypass techniques, and anti-bot evasion.
• Ability to optimize crawlers for performance and minimize website detection risks.
• Strong background in databases and data storage systems .
• Prior Experience of scraping large-scale E-Commerce websites would be plus.
• Willingness to learn and take feedback constructively.
• Excellent communication and leadership abilities.
  
  

(ref:hirist.tech)