Website:
fetchjobs.co
Job details:
About The Company
Turing, based in San Francisco, California, is recognized as the world's leading research accelerator dedicated to frontier artificial intelligence labs. As a trusted partner for global enterprises, Turing specializes in deploying advanced AI systems that drive innovation and competitive advantage. The company supports its clients through two primary avenues: first, by accelerating frontier research with high-quality data, sophisticated training pipelines, and top-tier AI researchers skilled in coding, reasoning, STEM, multilinguality, multimodality, and agent-based systems; second, by applying this expertise to help enterprises transform AI proofs of concept into proprietary intelligence solutions. These systems are designed to perform reliably, deliver measurable impact, and generate lasting results on the organization’s profit and loss statements. Turing’s commitment to excellence and innovation positions it as a leader in the AI research and deployment landscape, fostering a collaborative environment where cutting-edge advancements are translated into real-world solutions.
About The Role
We are seeking experienced Data Analysts (MLE Bench) to join our dynamic team and contribute to benchmark-driven evaluation projects focused on real-world machine learning systems. This role involves hands-on analytical work with production-like datasets, metrics, and machine learning outputs to evaluate, diagnose, and enhance the performance of advanced AI models. The ideal candidate will possess a strong analytical mindset, with the ability to work seamlessly at the intersection of data analysis and machine learning. You will be instrumental in defining evaluation metrics, analyzing model outputs, investigating failure modes, and collaborating with cross-functional teams to improve evaluation workflows. This position offers an exciting opportunity to work on complex datasets and contribute to the development and refinement of benchmark systems that influence the future of AI technology.
Qualifications
The successful candidate will have a minimum of three years of experience as a Data Analyst or an analytics-focused engineer. Proficiency in Python is essential, particularly for data analysis tasks, along with solid experience in SQL and working with relational datasets. A strong understanding of statistics and analytical reasoning is required to interpret complex data and derive actionable insights. Experience analyzing machine learning outputs and evaluation metrics is highly desirable. Candidates should have a proven ability to handle large, complex datasets and produce clean, well-documented analytical code. Excellent communication skills in English, both written and spoken, are necessary to effectively collaborate with team members and present findings clearly.
Responsibilities
- Analyze structured and unstructured datasets generated from machine learning training, inference, and evaluation pipelines to extract meaningful insights.
- Define, compute, and validate metrics used to assess model performance, behavior, and robustness across various benchmarks.
- Investigate data distributions, model outputs, failure modes, and edge cases relevant to benchmark tasks to identify areas for improvement.
- Develop and execute Python and SQL scripts to analyze data, generate reports, and support evaluation workflows, ensuring reproducibility.
- Validate data quality, consistency, and correctness across multiple datasets and experimental setups to maintain integrity.
- Create comprehensive, well-documented analytical artifacts and workflows that facilitate ongoing evaluation and research efforts.
- Collaborate closely with machine learning engineers and researchers to design challenging, real-world evaluation scenarios that push the boundaries of current systems.
Benefits
Joining Turing as a freelance Data Analyst offers the flexibility of working in a fully remote environment, allowing you to balance your professional and personal commitments effectively. You will have the opportunity to work on cutting-edge AI projects with leading large language model companies, gaining exposure to the latest advancements in the field. Turing provides a platform for continuous learning and professional growth, along with the chance to contribute to impactful projects that shape the future of artificial intelligence. Additionally, freelancers can benefit from a supportive community and access to a diverse range of challenging tasks that enhance skills and expertise in machine learning evaluation and data analysis.
Equal Opportunity
Turing is committed to fostering an inclusive and diverse work environment. We believe that different perspectives and backgrounds drive innovation and excellence. We provide equal employment opportunities to all qualified individuals regardless of race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, disability, or any other protected status. We encourage applicants from all backgrounds to apply and join our mission to advance frontier AI research and deployment.
Click on Apply to know more.