Advanced - UAT Tester - Mumbai

Job Summary

We are seeking a highly skilled Senior QA Automation Engineer with 10+ years of experience in software testing and automation. The ideal candidate should have strong expertise in UI and API test automation using Playwright with TypeScript and hands-on experience in Agentic AI testing, including AI-driven workflows, Large Language Models (LLMs), AI agents, and evaluation frameworks. The candidate will play a key role in designing, developing, and maintaining scalable automation frameworks while ensuring the quality of modern AI-powered applications. Domain knowledge and skills are a must.

Key Responsibilities

• Design, develop, and maintain robust UI and API automation frameworks using Playwright and TypeScript.
• Automate functional, regression, smoke, integration, and end-to-end test scenarios.
• Build reusable automation components and improve framework scalability and maintainability.
• Validate AI-driven applications, Agentic AI workflows, LLM-powered systems, and intelligent agents.
• Design and execute test strategies for AI models, prompts, workflows, and autonomous agent behaviors.
• Perform functional, integration, regression, and end-to-end testing for AI-based applications.
• Develop and execute evaluation frameworks to measure AI response quality, accuracy, reliability, safety, and performance.
• Automate API testing using REST APIs and validate request/response payloads.
• Collaborate with developers, product owners, business analysts, and AI/ML teams to understand business and technical requirements.
• Integrate automation suites into CI/CD pipelines and ensure continuous quality delivery.
• Perform defect tracking, root cause analysis, and support issue resolution.
• Prepare test plans, test cases, automation scripts, execution reports, and quality metrics.
• Mentor junior QA engineers and contribute to automation best practices.