About the role
As a Web Scraping focused Data Engineer, you will be responsible for extracting and ingesting data from websites using web crawling tools. In this role you will own the creation process of these tools, services, and workflows to improve crawl/ scrape analysis, reports, and data management.
The Opportunity
Mitigate reputation risk thru AI driven Data Quality to ensure highest quality data and services are offered to clients
Revenue generation thru New Business for Alternative Data
Communicating with third party vendors on specific data requirements for web scraping
Develop custom scripts and workflows using Python, SQL, and C# to automate data processing tasks.
Transforming and manipulating raw complex data into structured and consumable format data
Machine Learning and Quantitative Modeling
Build anomaly detection model leveraging packages like Prophet or similar
Build anomaly detection models for geospatial and other practices based on domain requirements.
This position description identifies the responsibilities and tasks typically associated with the performance of the position. Other relevant essential functions may be required.
