Role Overview:
We are seeking an experienced Physics Expert to lead a team of 5–10 technical trainers focused on developing scientific and technical tasks for advanced AI training and evaluation. This role involves reviewing computational physics tasks to ensure physical accuracy, reproducibility, and high-quality evaluation standards. You will mentor trainers and maintain consistent delivery of rigorous scientific tasks.
Responsibilities:
- Lead a pod of 5–10 technical trainers.
- Review scientific tasks and automated graders for physical correctness and reproducibility.
- Provide clear, constructive technical feedback to trainers.
- Maintain quality standards in scientific task development and evaluation.
Requirements:
- Ph.D., postdoctoral experience, or equivalent advanced expertise in Physics.
- Strong programming skills in Python, C/C++, Julia, or Fortran.
- Proficiency with Linux and terminal-based environments.
- Hands-on experience with computational physics, scientific simulations, or physics data analysis.
- Strong understanding of physical principles including dimensional consistency, conservation laws, numerical methods, and uncertainty analysis.
- Experience reviewing scientific code, technical analyses, simulations, or research outputs.
- Prior experience mentoring or leading small technical or research teams.
- Excellent written communication skills for providing technical feedback.
Preferred Qualifications:
- Familiarity with scientific tools such as QuTiP, Qiskit, Kwant, ITensor, ROOT, Geant4, Astropy, Dedalus, or MEEP.
- Experience with Docker, Git, continuous integration systems, and automated testing.
- Experience designing scientific benchmarks, programming tasks, or simulation-based evaluations.
Bonus Points:
- Experience evaluating AI coding or terminal-based agents.
- Experience working in large research collaborations with formal review processes.
- Prior involvement in AI training or evaluation programs.
Project Details:
- Commitment: Full-time, minimum 40 hours per week with at least 4 hours overlap with Pacific Standard Time (PST).
- Duration: 3 weeks.
- Employment Type: Contractor assignment (no medical or paid leave).
