Codefeast
Website:
codefeast.in
Job details:
Terminal-Bench 3.0 Expert – Senior Technical & Domain Specialist
Experience: 6+ Years, depending on domain
Job Type: Contractor
Compensation: $300 per approved task
Domain: Coding | Machine Learning | Media | Systems | Security | Hardware | Operations/Finance | Science
Role Overview
We are looking for experienced Terminal-Bench 3.0 Experts to design, implement, test, and validate high-quality benchmark tasks across technical and scientific domains.
Prior hands-on experience working on Terminal-Bench 3.0 projects is mandatory. Candidates without previous Terminal-Bench experience will not be considered.
Key Responsibilities
- Design realistic, multi-step Terminal-Bench 3.0 tasks based on domain-specific workflows.
- Build reproducible, self-contained computational environments with pinned dependencies.
- Create datasets, configurations, simulations, parameters, or other task-specific inputs.
- Implement expert reference solutions using programming languages or domain-specific tools.
- Develop automated tests, graders, and validation criteria.
Universal Requirements
- Previous hands-on Terminal-Bench 3.0 experience – Mandatory.
- Bachelor’s degree from a Top 100 institute/university in the country.
- Must meet the experience and educational requirements for at least one eligible domain.
- Strong analytical, technical, documentation, and problem-solving skills.
- Ability to independently handle task creation, implementation, testing, and validation.
Preferred Skills
- Experience evaluating AI coding agents or terminal agents.
- Experience creating benchmark tasks, automated graders, or evaluation pipelines.
- Research Software Engineering experience.
- Publications or open-source contributions involving computational science.
- Experience converting research or experimental workflows into reproducible computational packages.
Click on Apply to know more.
_1555561825510.png){kind=logo}
