Website:
fetchjobs.co
Job details:
About The Company
Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing supports customers in two ways: first, by accelerating frontier research with high-quality data, advanced training pipelines, plus top AI researchers who specialize in coding, reasoning, STEM, multilinguality, multimodality, and agents; and second, by applying that expertise to help enterprises transform AI from proof of concept into proprietary intelligence with systems that perform reliably, deliver measurable impact, and drive lasting results on the P&L.
About The Role
We are seeking experienced Data Analysts (MLE Bench) to join our team and contribute to benchmark-driven evaluation projects centered on real-world machine learning systems. This role involves hands-on analytical work with production-like datasets, metrics, and ML outputs to evaluate, diagnose, and enhance the performance of cutting-edge AI systems. The ideal candidate will have a strong background in data analysis and machine learning, with the ability to work effectively with complex datasets and evaluation workflows. You will collaborate closely with ML engineers and researchers to develop challenging, real-world evaluation scenarios that push the boundaries of current AI capabilities.
Qualifications
- Minimum of 3+ years of experience as a Data Analyst or analytics-focused engineer.
- Proficiency in Python, with extensive experience in data analysis and scripting.
- Solid understanding of SQL and experience working with relational databases.
- Experience analyzing ML outputs, evaluation metrics, and understanding model behavior.
- Strong foundation in statistics and analytical reasoning to interpret complex data.
- Ability to handle large, complex datasets and extract reliable insights.
- Experience in writing clean, well-documented, and reproducible analytical code.
- Excellent communication skills in spoken and written English, capable of articulating complex findings clearly and effectively.
Responsibilities
- Analyze structured and unstructured datasets generated from ML training, inference, and evaluation pipelines to identify patterns, anomalies, and areas for improvement.
- Define, compute, and validate metrics used to evaluate model performance, robustness, and behavior across various benchmarks.
- Investigate data distributions, model outputs, failure modes, and edge cases relevant to benchmark tasks to inform model development and evaluation strategies.
- Write and execute Python and SQL scripts to analyze data, generate reports, and support ongoing evaluation workflows.
- Validate data quality, consistency, and correctness across multiple datasets and experimental runs to ensure integrity and reproducibility.
- Create comprehensive, well-documented analytical artifacts, including reports, dashboards, and workflows, to facilitate transparency and knowledge sharing.
- Collaborate with ML engineers and researchers to design and refine challenging, real-world evaluation scenarios for MLE Bench projects.
Benefits
Joining Turing as a freelance Data Analyst offers the opportunity to work remotely from anywhere, providing flexibility and work-life balance. You will have the chance to work on cutting-edge AI projects with leading LLM companies, gaining exposure to the latest advancements in artificial intelligence and machine learning. Turing provides a dynamic and innovative work environment, where your analytical skills will directly contribute to the development and evaluation of next-generation AI systems. Additionally, freelancers can enjoy competitive compensation and the flexibility to choose projects that align with their expertise and interests.
Equal Opportunity
Turing is committed to fostering an inclusive environment where all employees and freelancers are treated with respect and fairness. We are an equal opportunity employer and do not discriminate based on race, ethnicity, gender, age, sexual orientation, disability, or any other protected characteristic. We believe diversity enhances innovation and creativity, and we welcome applicants from all backgrounds to join our team and contribute to our mission of advancing frontier AI research and applications.
Click on Apply to know more.