Website:
namasys.ai
Job details:
QA Tester-Functional Testing
Experience: 3–6 Years
Kynaa AI | Remote (India) | Full-time
About Kynaa AI
Kynaa AI is a voice-driven talent platform. An AI interviewer holds live spoken conversations with candidates and produces AI-scored assessments. The platform is a web application, Python/FastAPI backend services, a live voice pipeline, and an AI interview and scoring layer, with a candidate-facing product and two admin consoles (university and corporate).
This role owns functional quality: confirming that every feature, journey and integration does exactly what it is specified to do, on every release, across every role and device the product supports.
Scope of testing
- Requirement analysis. Review user stories and acceptance criteria before development starts; flag ambiguity, missing edge cases and untestable requirements.
- Test design. Write test cases with preconditions, steps, test data and expected results, using equivalence partitioning, boundary value analysis and decision tables. Maintain a traceability matrix from requirement to test case to result.
- Smoke testing. A fixed checklist run after every deploy, completed within 30 minutes: candidate login, interview start, voice connect, question flow, session end, score generation, report visible in the admin console.
- Sanity testing. Targeted re-check of the changed area after each fix, before full regression.
- Regression testing. Full pass over documented user journeys across the candidate product and both admin consoles before every release, with pass/fail history per release. Automated in Playwright where the UI is stable, manual where it is in flux.
- End-to-end testing. Complete flows: candidate invited → registers → completes voice interview → scored → report visible to university/corporate admin → exported.
- Integration testing. Web app ↔ backend APIs ↔ voice pipeline ↔ LLM and scoring layer ↔ database; email and notification delivery; any payment or invoicing flow.
- API testing. Every FastAPI endpoint: request/response contract, status codes, authentication, input validation, error handling, pagination, idempotency. Postman or pytest with httpx.
- Database and data integrity testing. Scores, transcripts, recordings and candidate records persist correctly in Postgres, verified with SQL. Zero cross-tenant leakage between universities or corporates.
- Role and permission testing. Candidate, university admin, corporate admin, Kynaa internal — every screen and endpoint tested for both allowed and denied access.
- Form and input validation testing. Every field: required, format, length, special characters, injection strings, error messaging.
- Voice pipeline functional testing. Microphone permission, connect and reconnect, interruption (barge-in), silence handling, session end, transcript accuracy spot checks.
- AI behaviour testing. Run the Python evaluation harnesses before any prompt, model or scoring change ships. Review a fixed weekly sample of real transcripts for off-script questions, invented facts, inconsistent scoring and tone. Convert every escaped defect into a new eval fixture.
- Cross-browser and device testing. Chrome, Edge, Safari, Firefox (latest two versions); Windows, iOS; laptop and mobile; headset and built-in mic.
- Exploratory testing. Time-boxed sessions with a written charter and logged findings.
- User acceptance testing support. Triage and reproduce feedback from pilot universities and corporates.
- Post-deploy verification. Confirm the release on production and give functional sign-off.
Responsibilities
- Own the functional test plan, test cases and traceability matrix.
- Write bug reports a developer can act on without calling you: title, environment, build, steps, expected vs actual, evidence (video, HAR, logs), severity and priority.
- Verify changes before merge, run post-deploy verification and give functional sign-off.
- Take live voice sessions with the product every day.
- Maintain the Playwright regression suite in the CI pipeline.
Definitions used in this role
Severity. S1 blocker: interview cannot start or complete, data loss, cross-tenant leak. S2 major: a core journey is broken with a workaround. S3 minor: non-core defect. S4 cosmetic.
Functional sign-off. No open S1 or S2, regression suite at 100% pass or each failure explicitly accepted, eval harness thresholds met, smoke checklist passed on production.
Qualifications
- 3–6 years in manual and automated functional testing of web applications.
- Test cases and bug reports you wrote yourself, used by a development team in production.
- API testing with Postman or Python; working SQL.
- Experience testing multi-role, multi-tenant SaaS products.
- Experience testing LLM-based or non-deterministic products is must.
Interested candidates can share their resume at recruitment@namasys.ai
Click on Apply to know more.