AI Agentic Studio QA

Role Overview:

Coditude is looking for an AI Agentic Studio QA professional with around 4 years of experience in quality assurance and test automation. The successful candidate will develop robust test strategies, maintain automated coverage for web applications and APIs, and help validate AI-enabled workflows involving large language models (LLMs), multi-agent systems, retrieval-augmented generation (RAG), tool calling, MCP, embeddings, and vector databases.

Key Responsibilities:

• Design test strategies and detailed test cases for complex features and workflows.
• Perform manual and automated testing to identify, document, track, and verify bugs and defects.
• Create, maintain, and improve automated test suites for functional, integration, web, and API testing.
• Participate in code reviews and provide constructive feedback on test automation code.
• Collaborate with developers and product managers to investigate issues, debug failures, and clarify requirements.
• Participate in Agile/Scrum ceremonies, communicate testing progress, and discuss defects, risks, and open issues.
• Validate AI-driven functionality, including prompt behavior, agent workflows, RAG, tool calling, and output quality.

Required Skills & Qualifications:

• Proficiency in Java programming and Git version control.
• Hands-on experience with web test automation using Selenium WebDriver and Java.
• Experience in API testing and automation, with working knowledge of Postman and REST Assured.
• Experience with the TestNG testing framework.
• Working knowledge of Maven and IntelliJ IDEA.
• Experience with or knowledge of Jenkins and CI/CD workflows.
• Understanding of Docker and containerization concepts.
• Understanding of LLM testing concepts, including multi-agent systems, RAG, tool calling, and MCP.
• Knowledge of testing embeddings and vector databases.
• Experience with prompt engineering and prompt/output validation.
• Understanding of Agile/Scrum methodologies and familiarity with Jira and Wiki applications.