AI Test Engineer
Birlasoft
Full Time4+ yearsPosted 14 days ago
Let the right jobs find you
Get personalised suggestions from verified company career pages, matched to your role, location, level, and skills.
Overview
Position Type
Full Time
Experience
4+ years
Job Description
Area(s) of responsibility
Job Title: Senior AI Test Engineer Experience: 4–5 Years Location: Hybrid / Onsite Employment Type: Full-time
Key Responsibilities
- Define and implement end-to-end test strategies for AI-enabled applications.
- Design and execute comprehensive test plans for Generative AI, LLM, RAG, and AI Agent workflows.
- Perform functional, integration, regression, system, and UAT testing.
- Validate RESTful APIs using tools such as Postman, Swagger, REST Assured, or similar frameworks.
- Develop and maintain API automation frameworks.
- Validate AI model responses for:
- Accuracy
- Relevance
- Consistency
- Hallucinations
- Bias
- Toxicity
- Test prompt engineering scenarios and optimize prompt quality.
- Validate Retrieval-Augmented Generation (RAG) pipelines and vector search accuracy.
- Verify AI guardrails, content moderation, and responsible AI compliance.
- Perform database validation using SQL.
- Conduct performance and load testing for APIs and AI services.
- Collaborate with Product Owners, Architects, Data Scientists, ML Engineers, and Developers