We're looking for a talented Python Engineer with strong web scraping experience to join our growing team.
๐๐๐ฒ ๐๐๐ฌ๐ฉ๐จ๐ง๐ฌ๐ข๐๐ข๐ฅ๐ข๐ญ๐ข๐๐ฌ
-Develop, maintain, and optimize web scraping solutions using Scrapy and Playwright.
-Implement effective logging mechanisms to track scraping activity, identify issues, and maintain system health.
-Research and implement strategies to bypass anti-bot measures, including CAPTCHA-solving, user-agent rotation, and IP management.
-Design and configure proxy solutions to ensure scraping efficiency and reliability.
-Work on backend APIs and services using FastAPI (experience is a plus).
-Collaborate with cross-functional teams to integrate scraping outputs into downstream systems.
-Write clean, efficient, and well-documented code following best practices.
-Troubleshoot and debug scraping and backend systems as needed.
๐๐ฎ๐๐ฅ๐ข๐๐ข๐๐๐ญ๐ข๐จ๐ง๐ฌ
-Proven expertise in web scraping using Scrapy and Playwright.
-Strong understanding of web protocols (HTTP, HTTPS), browser automation, and data parsing (HTML, JSON, XML).
-Hands-on experience with anti-bot evasion techniques, including:
CAPTCHA-solving tools and services.
-Rotating user agents and IPs.
-Proxy configuration and management (data center and residential).
-Proficient in implementing structured logging for debugging and monitoring purposes.
-Familiarity with FastAPI or similar Python frameworks is a plus.
-Experience with version control systems like Git.
-Strong problem-solving skills and attention to detail.
-Ability to work in a collaborative team environment.
๐๐จ๐ง๐ฎ๐ฌ ๐๐ค๐ข๐ฅ๐ฅ๐ฌ
Experience with cloud platforms (AWS, Azure, or GCP) for deploying scraping infrastructure.
Familiarity with containerization tools like Docker.
Experience with asynchronous programming in Python.
Knowledge of databases (SQL/NoSQL).
Understanding of CI/CD pipelines for automated deployments.
๐๐ก๐ฒ ๐๐จ๐ข๐ง ๐๐ฌ?
-Work on challenging, large-scale scraping projects with cutting-edge tools.
-Be part of a collaborative team that values learning and innovation.
-Competitive salary and growth opportunities.
-Flexible working environment.