QA Engineer
Bengaluru, India · Hybrid · Full-time
- Posted 4d ago
- From Hiver’s careers page
- Location
- Bengaluru, India
- Work mode
- Hybrid
- Type
- Full-time
- Level
- Senior
- Experience
- 4+ years
- Department
- Quality Assurance
Opens the listing on hiverhq.pinpointhq.com
Let the right jobs find you
In your inbox every Wednesday and SaturdayPersonalised suggestions from verified career pages, matched to your role, location, level and skills.
About the role
Opportunity:
We are looking for a AI Senior QA Engineer who will play a critical role in ensuring high product quality, reducing release risks, and scaling automation across teams. This is a hands-on, high-ownership individual contributor role where you will influence quality practices, collaborate deeply with engineers, and act as a quality champion within your product area. This role goes beyond test execution, you will help define how quality is built into the system while still being deeply involved in automation, debugging, and release readiness.
Key Responsibilities
- Quality Ownership & Execution
- Own end-to-end quality for assigned product areas/features.
- Design, review, and execute comprehensive test strategies (functional, regression, integration).
- Lead feature-level release sign-offs in collaboration with engineering and product.
- Actively debug failures across UI, backend, and APIs to identify root causes.
- Work closely with Customer Support to reproduce, analyze, and prevent customer-reported issues.
- Automation & Engineering Excellence
- Build, extend, and maintain automated test suites for UI, API, and backend services.
- Improve test reliability by identifying and fixing flaky tests.
- Drive reduction in manual regression time through automation ROI.
- Integrate automated tests into CI/CD pipelines and ensure fast feedback cycles.
- Collaborate with developers to shift quality left (testability, better coverage, early validation).
Key Requirements
- 4+ years of experience in software quality engineering.
- Hands-on QA experience on customer-facing AI features such as agents, copilots, RAG or classification.
- A track record of building and maintaining golden datasets from real customer data.
- Experience designing evals: rubrics, LLM-as-judge, and regression runs on every prompt or model change.
- Strong coded automation (Python or TypeScript, pytest or Playwright, CI) that replaces manual QA.
- The judgement to own the release bar for a non-deterministic product.
Good to Have skills?
- Experience with eval and observability tools such as Langfuse, LangSmith, Braintrust, Ragas, DeepEval or promptfoo.
- Red-teaming and safety testing: prompt injection, jailbreaks, PII leakage and bias.
- Background in B2B SaaS, customer support or helpdesk products.
- Synthetic test data or conversation generation, and using LLMs to generate test cases.
- Production quality monitoring, including sampling live traffic, human review loops and quality dashboards.
- Working knowledge of how LLM features are built (prompts, RAG, tool calling), so failures can be traced to a cause.
Skills they ask for
Pick one to see other roles that ask for it.
About Hiver
Agentic customer service platformHiver is an agentic customer service platform where teams and AI work together to resolve customer issues across channels.
See all 9 roles at HiverMore roles at Hiver
See all 9- SDE 3 - BackendBengaluru · Senior · HybridEngineering · Senior · HybridBengaluru, India2d
- Full Stack Software Development EngineerBengaluru · Senior · HybridSoftware Development · Senior · HybridBengaluru, India2d
- Employee Experience & Community AssociateBengaluru · On-siteHuman Resources · On-siteBengaluru, India2d
- Software Development Engineer III (Frontend)Bengaluru · Senior · HybridEngineering · Senior · HybridBengaluru, India3d
Let the right jobs find you
In your inbox every Wednesday and SaturdayPersonalised suggestions from verified career pages, matched to your role, location, level and skills.