Website:
invesmategroup.com
Job details:
ABOUT THE ROLE
We are looking for an AI Operations & QA Analyst to be the connective tissue between our AI agents, product teams, and business units. You will ensure our AI agents get the quality data they need, perform reliably in production, and that our digital products meet consistent quality standards.
This is a hybrid role — part data operations, part AI evaluation, part product QA — ideal for someone who enjoys variety, cross-functional work, and being close to how AI actually gets built and shipped.
KEY RESPONSIBILITIES
AI Data Operations
• Coordinate with cross-functional teams (sales, marketing, operations, customer success) to collect, structure, and maintain data required by our AI agents.
• Own the data intake pipeline: identify gaps, define collection protocols, and ensure data quality, consistency, and freshness.
• Document data sources, formats, ownership, and update cadence.
• Escalate blockers and drive team-level accountability for data hand-offs.
AI Agent Testing & Evaluation
• Design and execute test cases for AI agent behavior across real-world scenarios.
• Track accuracy, hallucinations, edge cases, and regressions across model or prompt updates.
• Maintain evaluation datasets and log issues with clear, reproducible steps.
• Partner with engineering and product to prioritize fixes and validate improvements.
Product QA — App & Web
• Perform manual QA across mobile app and web products.
• Write and maintain test cases, execute regression cycles before every release.
• Track bugs in JIRA / Linear / ClickUp, verify fixes, and support release sign-off.
• Support UAT and coordinate release readiness with product and engineering leads.
REQUIRED SKILLS & EXPERIENCE
• 1-2 years of experience in QA, operations, or a hybrid analyst role.
• Strong written and verbal communication in English (Bengali/Hindi a plus for team coordination).
• Proficient in Excel / Google Sheets; SQL basics a strong plus.
• Comfortable with bug tracking tools (JIRA, Linear, ClickUp, or equivalent).
• Highly detail-oriented; able to juggle multiple projects simultaneously.
• Self-directed — comfortable driving follow-ups without heavy supervision.
NICE TO HAVE
• Prior experience testing AI, chatbot, or LLM-powered products.
• Exposure to data annotation platforms or prompt engineering.
• Familiarity with API testing tools (Postman) or basic scripting (Python).
WHAT YOU'LL GET
• Direct exposure to cutting-edge AI product development.
• A clear growth path — into AI Product Manager, QA Lead, or AI Operations Lead roles.
- Supportive leadership and a small, collaborative team.
Click on Apply to know more.
