PwC
Website:
pwc.com
Job details:
At PwC, our people in software and product innovation focus on developing cutting-edge software solutions and driving product innovation to meet the evolving needs of clients. These individuals combine technical experience with creative thinking to deliver innovative software products and solutions. In testing and quality assurance at PwC, you will focus on the process of evaluating a system or software application to identify any defects, errors, or gaps in its functionality. Working in this area, you will execute various test cases and scenarios to validate that the system meets the specified requirements and performs as expected.
Focused on relationships, you are building meaningful client connections, and learning how to manage and inspire others. Navigating increasingly complex situations, you are growing your personal brand, deepening technical expertise and awareness of your strengths. You are expected to anticipate the needs of your teams and clients, and to deliver quality. Embracing increased ambiguity, you are comfortable when the path forward isn’t clear, you ask questions, and you use these moments as opportunities to grow.
Skills
Examples of the skills, knowledge, and experiences you need to lead and deliver value at this level include but are not limited to:
- Respond effectively to the diverse perspectives, needs, and feelings of others.
- Use a broad range of tools, methodologies and techniques to generate new ideas and solve problems.
- Use critical thinking to break down complex concepts.
- Understand the broader objectives of your project or role and how your work fits into the overall strategy.
- Develop a deeper understanding of the business context and how it is changing.
- Use reflection to develop self awareness, enhance strengths and address development areas.
- Interpret data to inform insights and recommendations.
- Uphold and reinforce professional and technical standards (e.g. refer to specific PwC tax and audit guidance), the Firm's code of conduct, and independence requirements.
Email Address
Hiring Partner/MD
Vineeta Bansal
AC or US Core
AC
Offering
Enterprise Testing Managed Services
Reason for Requisition Request
Project
Role Name
AI Test Automation Specialist
Recommended Job Posting Title
Senior Associate
Job Description Summary
Job Summary:
We are seeking an AI Focused QA Automation Engineer to design, implement, and execute robust testing strategies for AI driven systems, including LLM based applications, RAG pipelines, and AI assisted workflows. The role requires strong foundations in QA automation, combined with AI test design, validation of model responses, and exploratory testing for nondeterministic systems.
The candidate will be hands‑on in validating agent reasoning, planning, memory, orchestration, and AI‑driven workflows, ensuring reliability, accuracy, and enterprise readiness of AI solutions. The role requires strong QA automation fundamentals, exposure to AI/GenAI testing, and the ability to collaborate closely with engineering, product, and data teams.
Key Responsibilities
- Design and implement automation frameworks for UI, API, and AI driven applications
- Validate LLM responses, prompts, AI workflows, and RAG pipelines for accuracy, faithfulness, and context relevance
- Develop AI test cases covering LLM, RAG, and prompt‑driven flows
- Integrate LLMs with test automation frameworks to:
- Auto‑generate test cases
- Validate AI responses
- Assist in script creation using AI‑assisted coding
- Perform functional, regression, and exploratory testing of AI systems
- Evaluate RAG performance using frameworks like RAGAS (faithfulness, context precision, answer relevance)
- Create and manage test datasets, telemetry, and logs for AI validation
- Collaborate with engineering, data, and ML teams to improve test reliability and AI quality
Qualifications And Skills
- Bachelor’s or master’s degree in computer science, Engineering, Data Science, or equivalent experience.
- 6+ years of experience in QA automation or software engineering.
- 3+ years of experience working with AI‑driven automation or intelligent testing frameworks.
- Minimum 2 years of hands‑on experience in building or testing AI‑based tools or platforms.
Tools & Technologies
Must Have Tools
- Selenium / Playwright / Cypress / Appium
- REST Assured / Postman
- Python / Java / JavaScript / TypeScript test frameworks
- PyTest / JUnit / TestNG
- Jira / TestRail
- AWS CloudWatch / Grafana / Prometheus
- Cursor AI / GitHub Copilot / OpenAI APIs
Good To Have Tools
- Testim / Mabl (Self‑Healing Automation)
- Promptfoo (Prompt Validation)
- RAGAS (RAG Evaluation)
- Comet ML (Experiment Tracking)
- MLflow (Basic Metrics Tracking)
- K6 / Locust (Performance Testing)
- Katalon Studio
- TOSCA VisionAI
Nice To Have Tools
- Cursor AI
- GitHub Copilot
- Open‑source LLMs (LLaMA, Mistral)
- Claude / Gemini
- Synthetic data generators
- KaneAI / Functionize
Communication
- Strong verbal and written communication skills, with the ability to clearly articulate defects, risks, and quality insights.
- AI & GenAI Testing Skills:
- Hands‑on experience in testing AI/LLM‑based systems, including prompt‑driven workflows, RAG pipelines, and agent‑based solutions.
- Strong exposure to prompt engineering, prompt validation, and response evaluation techniques.
Additional Information
- Travel Requirements: Travel to client locations may be required as per project requirements.
- Shift Requirements: Required to work on shift as per project requirements.
- Line of Service: Advisory
- Industry: Enterprise Testing Managed Services
- Designation: Senior Associate
- Location: Bangalore, India (ONLY)
Position Level
Senior Associate
Number of Openings
1
Target Location
India AC (Bangalore)
Demand Justification
Specific Client Need
Client Name
Lennar
Client Utilization %
100%
Tower Alignment
CEDA
Target Resource Start Date
03/15/2026
Duration of Engagement
12 months
Tracker ID
Click on Apply to know more.