Deep Research Annotator (Computer Science)

About Us:

We are a new-age AI solutions firm with an ultra-high-quality talent pool out of India for RLHF. Our experts in the specific domain of their expertise help curate hyper-specific LLM datasets. We have operations across the US and India and are working with the top AI firms globally to take their large language models (LLMs) to the next level of quality and consistency.

About the Role

You will evaluate CS reasoning across algorithms, systems, ML, and theoretical concepts.

The job involves validating research claims, checking code logic, and analyzing methodology.

Ideal for candidates with strong CS fundamentals and research exposure.

Responsibilities

• Annotate reasoning in ML, algorithms, systems, and security questions
• Validate code snippets, proofs, and experiment setups
• Check alignment between claims, evidence, and methodology
• Identify inconsistencies, hallucinations, or unsupported arguments
• Produce structured annotations to train high-quality CS models

Skills & Experience Required

• BSc/MSc in Computer Science, ML, or related areas
• Strong understanding of ML fundamentals, algorithms, or systems architecture
• Experience reading CS papers, verifying experiments, or debugging code
• Skilled in evaluating ML claims, algorithmic proofs, code correctness, and research reasoning.