Senior Data Scientist

About the Company: yupp.ai is the best place to discover and compare AI models. We work on 
the cutting edge of GenAI and are focused on building great consumer products for the AI era. 

Job Summary: We are looking for a Senior/Staff-level Data Scientist with deep technical expertise 
and product intuition to join our team, leading development of data-driven systems to power our 
evaluation engines, leaderboards, and recommendation layers, and build mechanisms to derive 
business insights from data. The ideal candidate has a strong foundation in statistical inference, 
experimentation, and machine learning, and is comfortable designing novel evaluation methods. 
You will work cross-functionally with engineers, researchers, and product managers to turn data 
into insights and insights into product direction. 

Responsibilities: 
1. Design and lead experiments to evaluate and rank models using human and behavioral 
feedback; develop novel methodologies for sampling, aggregation, and bias correction. 
2. Collaborate with engineering to productionize data pipelines and evaluation logic at 
scale. 
3. Perform deep dives into usage data to surface insights that shape product and research 
priorities. Track critical business metrics through data collection, visualization, and 
recommendations. Troubleshoot and debug data inconsistencies and irregularities. 
4. Participate in product building through contributing production code, DB schema design, 
and more. 

Qualifications: 
1. 10+ years of experience in data science, applied ML, or related fields. 
2. Strong knowledge of experimental design, causal inference, and statistical modeling. 
3. Proficient in Python and data science libraries (e.g., NumPy, pandas, scikit-learn, 
statsmodels). 
4. Experience with modern ML techniques for ranking, embeddings, and preference 
learning. 
5. Familiarity with large-scale data processing tools (e.g. BigQuery) and SQL. 
6. Strong communication skills and ability to frame abstract problems in product-relevant 
ways. 

Preferred Qualifications: 
1. Experience in consumer AI, recommender systems, or human-in-the-loop evaluation. 
2. Prior work on LLM evaluation or reinforcement learning from human feedback (RLHF).
3. Familiarity with modern experiment platforms and A/B testing infrastructure. 

If you are passionate about creating exceptional user experiences and thrive in a dynamic and 
collaborative environment, we would love to hear from you.