Website:
fetchjobs.co
Job details:
About The Company
Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing supports customers in two ways: first, by accelerating frontier research with high-quality data, advanced training pipelines, plus top AI researchers who specialize in coding, reasoning, STEM, multilinguality, multimodality, and agents; and second, by applying that expertise to help enterprises transform AI from proof of concept into proprietary intelligence with systems that perform reliably, deliver measurable impact, and drive lasting results on the P&L.
About The Role
We are seeking experienced Data Analysts (MLE Bench) to join our team and contribute to benchmark-driven evaluation projects focused on real-world machine learning systems. This role involves hands-on analytical work with production-like datasets, metrics, and ML outputs to evaluate, diagnose, and improve the performance of advanced AI systems. The ideal candidate will have a strong background in data analysis and machine learning, with the ability to work effectively with complex datasets and evaluation workflows. This position offers an exciting opportunity to work on cutting-edge AI projects, collaborate with top-tier researchers and engineers, and make a measurable impact on the development and deployment of AI technologies.
Qualifications
The successful candidate will possess a minimum of 3+ years of experience as a Data Analyst or analytics-focused engineer. Proficiency in Python for data analysis is essential, along with solid experience using SQL to manage and analyze relational datasets. A strong understanding of statistics and analytical reasoning is required to interpret ML outputs and evaluation metrics effectively. Candidates should have demonstrated experience working with large, complex datasets and drawing reliable insights. Excellent communication skills in English, both spoken and written, are necessary to document findings clearly and collaborate effectively with cross-functional teams. Familiarity with ML evaluation workflows and understanding of model performance metrics will be advantageous.
Responsibilities
- Analyze structured and unstructured datasets generated from ML training, inference, and evaluation pipelines to identify patterns, anomalies, and areas for improvement.
- Define, compute, and validate metrics used to evaluate model performance and behavior, ensuring alignment with project goals.
- Investigate data distributions, model outputs, failure modes, and edge cases relevant to benchmark tasks to inform model development and evaluation strategies.
- Write and run Python and SQL scripts to analyze data, generate reports, and support evaluation workflows, ensuring reproducibility and accuracy.
- Validate data quality, consistency, and correctness across datasets and experiments to maintain integrity and reliability of evaluation results.
- Create clear, well-documented analytical artifacts, including reports, dashboards, and workflows, to facilitate understanding and collaboration.
- Collaborate closely with ML engineers and researchers to design challenging, real-world evaluation scenarios that accurately reflect deployment conditions and performance expectations.
Benefits
Joining Turing as a freelance Data Analyst offers the flexibility to work remotely from anywhere, providing a healthy work-life balance and the convenience of a fully remote environment. You will have the opportunity to work on pioneering AI projects with leading LLM companies, gaining valuable experience in cutting-edge technology and research. Turing also provides a supportive community of talented professionals and access to a diverse range of AI initiatives, enabling continuous learning and professional growth. This role offers competitive engagement terms and the chance to contribute to impactful AI solutions that shape the future of technology.
Equal Opportunity
Turing is committed to fostering an inclusive environment and equal opportunity employment. We celebrate diversity and are dedicated to creating a workplace where all employees and contractors are valued and respected. We do not discriminate based on race, ethnicity, gender, sexual orientation, age, disability, or any other protected characteristic. We believe that diverse perspectives drive innovation and excellence, and we welcome applicants from all backgrounds to join our team.
Click on Apply to know more.