Williams-Sonoma
Website:
williams-sonomainc.com
Job details:
Job Role - Lead Test Automation Engineer (AI)
Location - Pune (Hybrid)
1. Job Summary / Purpose
We are seeking a Lead Test Automation Engineer who operates at the intersection of modern test automation and Agentic AI systems. This role focuses on designing workflows where AI agents can deliver tests end-to-end while ensuring quality through robust guardrails, validation systems, and security practices. The role is critical in enabling teams to scale productivity and deliver high-quality software in an AI-native development environment.
2. Key Responsibilities
- Design and implement agentic workflows for end-to-end tests delivery using AI agents
- Define and maintain guardrails such as AGENTS.md, validation checkpoints, and test frameworks
- Architect and scale UI and API test automation frameworks
- Write clear, maintainable, and reusable test specifications
- Critically evaluate AI-generated code and test outputs for accuracy and completeness
- Identify and mitigate AI-related security risks such as over-permissions, insecure dependencies, and data leakage
- Establish metrics to measure team productivity and AI impact
- Mentor team members on modern QA practices and AI-driven development workflows
3. Technical Skills (including Agentic AI)
- Strong experience with test frameworks: JUnit, Cucumber, RestAssured, Mock frameworks
- Expertise in UI automation tools such as Selenium, Playwright, or Cypress
- Solid understanding of API testing and backend validation strategies
- Strong SQL skills for data validation and debugging
- Proficiency in Java or similar programming languages
- Understanding of AI systems, workflows, and prompt/instruction design (e.g., AGENTS.md)
- Ability to design test strategies for AI-generated code and workflows
- Experience critically assessing AI outputs and improving their reliability
4. Soft Skills
- Strong critical thinking and analytical skills
- Ability to adapt quickly to evolving AI technologies and tools
- Clear and effective communication, especially in writing specifications
- Ownership mindset focused on team-level impact
- Problem-solving mindset with attention to detail
- Reviewing the work from junior members in the test automation team and help them grow to use Agentic AI workflows
5. Nice to Have
- Experience with CI/CD pipelines and automated testing integration
- Exposure to AI safety, governance, and secure system design
- Experience testing microservices or distributed systems
- Familiarity with modern DevOps practices
6. Minimum Qualifications
- BE / BTech / ME / MTech in Computer Science or related field
- 10+ years of experience in test automation or software engineering
Click on Apply to know more.