About Scaler AI Labs
Scaler AI Labs is Scaler’s frontier AI research and engineering division. We build Reinforcement Learning (RL) environments for the world’s leading AI research companies.
We ship fast, maintain high quality bars, and work directly with world-class AI researchers. If you want to work at the intersection of product, engineering, and frontier AI, this is the team.
Role Overview
As a Manual QA Engineer, you will be responsible for validating RL environments before they are shipped to clients. You’ll work closely with developers and product teams to identify bugs, test workflows, validate task graders, and ensure environments meet the required quality bar.
What You’ll Do
Environment QA
- Test web applications, UI flows, workflows, and edge cases.
- Create and execute test cases based on product requirements.
- Perform functional, regression, exploratory, and negative testing.
- Identify and document bugs with clear reproduction steps and expected vs. actual behaviour.
- Re-test fixes and run regression checks before release.
- Identify gaps in requirements and test coverage.
- Sign off on environments that meet the quality bar.
Task & Grader Testing
- Test task prompts for clarity, accuracy, and completeness.
- Verify that tasks can be completed as intended.
- Test graders for correct pass/fail evaluation.
- Identify grader bugs, edge cases, false positives, and false negatives.
- Validate that the final environment state matches the expected task outcome.
QA Process
- Maintain test cases, test plans, and regression checklists.
- Participate in requirement and feature discussions from a QA perspective.
- Prioritize bugs based on severity and impact.
- Work closely with developers to investigate and resolve issues.
- Manage multiple QA cycles and releases in parallel.
What We’re Looking For
Must Have
- 1–3 years of experience in Manual QA / Software Testing.
- Experience testing web applications or SaaS products.
- Strong understanding of functional, regression, exploratory, and negative testing.
- Strong attention to detail and ability to identify edge cases.
- Ability to write clear and actionable bug reports.
- Ability to create test scenarios independently.
- Good understanding of bug lifecycle and severity classification.
- Strong communication and collaboration skills.
- Comfortable working in a fast-paced environment with tight deadlines.
- Willingness to work from our Bangalore office, including flexible shifts when required.
Good to Have
- Experience testing enterprise SaaS or B2B products.
- Familiarity with Jira, GitHub, Google Sheets, or Postman.
- Basic understanding of APIs, databases, frontend/backend systems, and data seeding.
- Experience testing products such as Salesforce, NetSuite, Canva, Power BI, DocuSign, or similar enterprise applications.
- Experience writing structured test cases and regression suites.
- Exposure to AI products, LLMs, or AI evaluation.