Intelo.ai
Website:
intelo.ai
Job details:
Senior QA Automation Engineer
Location: Kochi, Delhi NCR (Full-time, On-site)
Company: Intelo.ai
About Intelo
Intelo is a transformation partner building AI agents that drive efficiency, accuracy, and growth across businesses. We solve critical retail and supply chain workflows using purpose-built AI technology.
Our platform enables retailers to:
- Forecast demand accurately
- Reduce excess inventory
- Improve sell-through
- Make faster, smarter decisions
We operate at the intersection of AI, data engineering, and product thinking - building systems that translate complex data into real business outcomes.
Role Overview
We are looking for a Senior QA Automation Engineer (3-5 years of experience) to build the automated safety net that lets Intelo ship weekly without fear. Today, testing is largely manual and concentrated at the end of the cycle - your mission is to shorten and automate it, turning our smoke tests, regression suites, and release checks into fast, reliable, CI-gated automation.
Quality at Intelo is an engineering responsibility, not a stage at the end. You will be the person who makes "zero bugs in delivered functionality" achievable and measurable - testing complex, data-driven AI workflows end to end across APIs, data pipelines, and agent behavior, over dev, UAT, and prod.
What We Expect from Every Engineer at Intelo
This is part of our operating philosophy.
Here to Make a Difference
- Challenges the status quo
- Experiments boldly
- Adapts when the ground shifts
Open by Default
- Raises concerns early
- Shares knowledge transparently
Owns It
- Takes initiative
- Follows process even when it's hard
- Makes decisions with context - not escalation
Product Over Tickets
- Thinks from the customer backwards
- Fights unnecessary complexity
- Automates repetitive work
Always Learning
- Seeks deep understanding
- Uses AI as leverage to improve thinking and output
- Continuously upgrades technical and product judgment
Key Responsibilities
Test Automation & Frameworks
- Design and build automated test suites: integration, API, end-to-end, and regression
- Establish frameworks and patterns the whole team can extend (e.g., pytest, Playwright/Cypress, API testing)
- Make tests fast, deterministic, and trustworthy - no flaky gates that erode confidence
CI/CD Quality Gates
- Wire automated tests into our CI/CD pipelines (GitHub Actions) as required checks
- Own the automated smoke-test suite that runs post-deploy and informs go/no-go and rollback decisions
- Shorten the test cycle so UAT sign-off is quick and reliable, enabling a confident weekly release
Data & Pipeline Validation
- Validate data correctness across Databricks and PostgreSQL pipelines (forecasts, allocations, exports)
- Build data-diffing and contract tests that catch silent data regressions
- Verify batch and streaming outputs against expected results
AI / Agent Quality
- Design evaluation harnesses for AI agent behavior - accuracy, consistency, and regression detection across prompt and model changes
- Partner on eval datasets and metrics (e.g., Langfuse-based evaluations), tracking success and failure rates over time
- Catch agent regressions before they reach customers
Release & Regression Ownership
- Own the regression strategy across the release cadence
- Triage, reproduce, and drive defects to root cause; prevent recurrence
- Report quality metrics (coverage, defect-escape rate, flake rate) that drive decisions
Collaboration & Quality Culture
- Partner with engineering and product to build testability in from the start
- Champion quality as a shared responsibility owned across the team, not a gate at the end
Required Qualifications
- 3-5 years of professional experience in software QA, with a strong test-automation focus
- Strong experience designing and building automated test frameworks from the ground up
- Proficiency in a test-automation language (Python and/or TypeScript/JavaScript)
- API testing experience (REST) with tools such as pytest, Postman, or supertest
- End-to-end UI automation (Playwright, Cypress, or Selenium)
- Solid understanding of CI/CD and integrating tests as pipeline gates (GitHub Actions preferred)
- SQL and hands-on data-validation skills
- Strong analytical, debugging, and problem-solving skills
- Bachelor's degree in Computer Science or related field, or equivalent practical experience
Preferred Experience
We would prefer engineers with experience in:
- Testing data-intensive systems (Databricks / Spark, data pipelines)
- Evaluating AI/ML or LLM-based systems (eval frameworks, Langfuse, model/agent testing)
- Performance and load testing (k6, Locust, or JMeter)
- Contract testing and test-data management
- Working in a fast-moving, weekly-release environment
What This Role Owns at Intelo
A QA Automation Engineer at Intelo:
- Owns the automated safety net, not a manual checklist
- Makes quality fast - shortening cycles, not lengthening them
- Thinks like an adversary and a customer at the same time
- Turns every escaped bug into a permanent automated check
- Raises the quality bar for the whole team
Why Join Intelo
- Build the quality foundation of a fast-scaling AI platform from the ground up
- High ownership and visibility
- Work on genuinely hard testing problems - data correctness and AI behavior, not just CRUD
- Fast-moving, product-first environment
- Culture that rewards initiative and deep thinking
Click on Apply to know more.