Orangebits Software Technologies (India) Pvt Ltd
Website:
orangebitsindia.com
Job details:
Hiring Alert: AI QA Engineer | PAN India (Remote/WFH)
We are looking for experienced AI QA Engineers to join a high-impact team working on cutting-edge Generative AI & Agentic AI solutions. If you’re passionate about ensuring quality, reliability, and ethical AI systems—this is for you!
Location: PAN India ( Remote)
Shift: UK Shift (12 PM – 9 PM IST, Mon–Fri)
Experience: 5+ Years
Joining: Immediate Joiners Only
Role Overview
· As an AI QA Engineer, you will:
· Test large-scale AI systems (GenAI & Agentic AI)
· Build and execute manual + automated test cases
· Ensure quality in CI/CD pipelines
· Validate AI outputs, prompts, and model behavior
· Drive QA best practices and mentor team members
Must-Have Skills
· Strong experience in AI/ML application testing
· Hands-on with test automation (Python, Selenium, Tosca)
· Knowledge of QA methodologies (Agile, DevOps, BDD)
· Experience in Generative AI testing & prompt validation
· Understanding of Agentic AI concepts
· Knowledge of Responsible AI (bias, fairness, explainability, privacy)
· Exposure to DevSecOps & CI/CD pipelines
· Familiarity with Jira / Azure DevOps
· Programming knowledge (Java / C#)
Good to Have
· Experience in Agentic AI solution testing
· Performance & load testing for AI systems
· Knowledge of data governance in AI
· ISTQB (Foundation / Agile / AI Tester)
Click on Apply to know more.