Python Engineer (Web scraping)

We're looking for a talented Python Engineer with strong web scraping experience to join our growing team.

𝐊𝐞𝐲 𝐑𝐞𝐬𝐩𝐨𝐧𝐬𝐢𝐛𝐢𝐥𝐢𝐭𝐢𝐞𝐬

-Develop, maintain, and optimize web scraping solutions using Scrapy and Playwright.

-Implement effective logging mechanisms to track scraping activity, identify issues, and maintain system health.

-Research and implement strategies to bypass anti-bot measures, including CAPTCHA-solving, user-agent rotation, and IP management.

-Design and configure proxy solutions to ensure scraping efficiency and reliability.

-Work on backend APIs and services using FastAPI (experience is a plus).

-Collaborate with cross-functional teams to integrate scraping outputs into downstream systems.

-Write clean, efficient, and well-documented code following best practices.

-Troubleshoot and debug scraping and backend systems as needed.

𝐐𝐮𝐚𝐥𝐢𝐟𝐢𝐜𝐚𝐭𝐢𝐨𝐧𝐬

-Proven expertise in web scraping using Scrapy and Playwright.

-Strong understanding of web protocols (HTTP, HTTPS), browser automation, and data parsing (HTML, JSON, XML).

-Hands-on experience with anti-bot evasion techniques, including:

CAPTCHA-solving tools and services.

-Rotating user agents and IPs.

-Proxy configuration and management (data center and residential).

-Proficient in implementing structured logging for debugging and monitoring purposes.

-Familiarity with FastAPI or similar Python frameworks is a plus.

-Experience with version control systems like Git.

-Strong problem-solving skills and attention to detail.

-Ability to work in a collaborative team environment.

𝐁𝐨𝐧𝐮𝐬 𝐒𝐤𝐢𝐥𝐥𝐬

Experience with cloud platforms (AWS, Azure, or GCP) for deploying scraping infrastructure.

Familiarity with containerization tools like Docker.

Experience with asynchronous programming in Python.

Knowledge of databases (SQL/NoSQL).

Understanding of CI/CD pipelines for automated deployments.

𝐖𝐡𝐲 𝐉𝐨𝐢𝐧 𝐔𝐬?

-Work on challenging, large-scale scraping projects with cutting-edge tools.

-Be part of a collaborative team that values learning and innovation.

-Competitive salary and growth opportunities.

-Flexible working environment.