Software Engineer (Data Acquisition)

Overview

Daash Intelligence is a well-funded tech start-up at the forefront of next-gen predictive commerce intelligence. Our mission is to make retail markets more transparent, enabling customers to track and predict market trends more easily, thoroughly, and affordably. This is crucial because countless small and mid-sized consumer brands struggle to compete with larger companies that invest millions in market research. Daash tackles this by democratizing access to the actionable intelligence these brands need to thrive.

Our rapidly growing team of dedicated scientists, engineers, and business leaders is united in this vision, and the market response has been incredible! While in stealth mode, we quickly secured over 40 high-profile clients using our platform for their business decisions. Join us and contribute to our collaborative and innovative team as we revolutionize the commerce intelligence industry!

About the role

We are looking for a talented and driven Software Engineer to join our "Data Acquisition" team, which is responsible for acquiring public data using large-scale web crawlers. Most of Daash's research and products are built on ML and AI models, which depend on high-quality data used for model training and powerful analytics. Successfully expanding our data corpus is vital to this effort.

At Daash we work as a single cohesive team on just a few large-scale projects. We are an extremely collaborative group, and we host frequent research discussions to ensure that we are pursuing the highest-value work at any given time. As such, we greatly value a high level of communication skills and awareness of broader company goals and objectives.

Responsibilities

• Develop and maintain large-scale web crawlers
• Help improve the observability, maintainability and debuggability of the overall crawler system
• Collaborate with team members on improving data acquisition processes
• Participate in code reviews and debugging sessions
• Participate in strategy and analysis for new data acquisition targets
• Complete analyses scraper data output for accuracy evaluation

Minimum qualifications

• Advanced/fluent in Python (OOP concepts like multiple inheritance)
• Proficient in at least on web scraping framework (Scrapy, preferred)
• Proficient in using Python pandas for data analysis
• A foundational knowledge of how modern websites work: client-side vs server-side sites; static vs dynamic HTML; APIs; headers; user-agents; cookies; token authentication; using the browser console.
• Experience with Jupyter notebooks
• Experience with Github for source control

Preferred qualifications

• Proficiency in SQL
• Experienced with navigating blocks or maintaining web scrapers
• Experienced with AWS (S3, Athena, Cloudwatch)
• Have developed with GraphQL or a front-end framework
• Have a strong grasp of event-driven/asynchronous programming
• Have worked in the e-commerce or retail industries
• Bachelor's degree in Computer Science, Engineering, or a related field
• 1-2 years of experience in data engineering or a related field

Benefits

• Base Salary: $100,000 - $130,000 (depending on experience and qualifications)
• Performance-Based Bonus: Eligible for an annual bonus based on individual and company performance
• Equity: Opportunity to participate in the company's equity program, with grants awarded based on performance and role level
• Comprehensive Health, Dental and Vision insurance plan coverage
• Unlimited PTO policy
• Hybrid office/home environment with flexible scheduling (though the company operates on Eastern Standard Time)

Location

• New York preferred

Company Benefits

At Daash we understand the importance of employee satisfaction and well-being. That's why we offer a range of benefits to support our employees both personally and professionally. Our benefits package includes competitive salary packages, hybrid work and flexible schedules to promote work-life balance, comprehensive health insurance coverage, and an unlimited PTO policy. We also encourage professional development and opportunities for growth within the company. In addition, we have special incentives such as parental leave, wellness programs, and company events to promote a positive work experience. Join us and enjoy the benefits of being a part of our team!

Equality Opportunity Statement

Daash Intelligence, Inc is an equal opportunity employer. We value diversity and do not discriminate on the basis of race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status. We are committed to creating an inclusive and supportive work environment where every individual feels valued and empowered.