Software Testing Lead
Noida, India · Full-time
- Posted 1w ago
- From Dailoqa’s careers page
- Location
- Noida, India
- Type
- Full-time
- Level
- Lead
- Experience
- 10+ years
- Department
- Software Development
Opens the listing on dailoqa.zohorecruit.in
Let the right jobs find you
In your inbox every Wednesday and SaturdayPersonalised suggestions from verified career pages, matched to your role, location, level and skills.
About the role
Role Overview:
As a Test Automation Lead at Dailoqa, you'll architect and implement robust testing frameworks for both software and AI/ML systems. You'll bridge the gap between traditional QA and AI-specific validation, ensuring seamless integration of automated testing into CI/CD pipelines while addressing unique challenges like model accuracy, GenAI output validation, and ethical AI compliance.
Key Responsibilities:
Test Automation Strategy & Framework Design
- Design and implement scalable test automation frameworks for frontend (UI/UX), backend APIs, and AI/ML model-serving endpoints using tools like Selenium, Playwright, Postman, or custom Python/Java solutions.
- Build GenAI-specific test suites for validating prompt outputs, LLM-based chat interfaces, RAG systems, and vector search accuracy.
- Develop performance testing strategies for AI pipelines (e.g., model inference latency, resource utilization).
Continuous Testing & CI/CD Integration
- Establish and maintain continuous testing pipelines integrated with GitHub Actions, Jenkins, or GitLab CI/CD.
- Implement shift-left testing by embedding automated checks into development workflows (e.g., unit tests, contract testing).
AI/ML Model Validation
- Collaborate with data scientists to test AI/ML models for accuracy, fairness, stability, and bias mitigation using tools like TensorFlow Model Analysis or MLflow.
- Validate model drift and retraining pipelines to ensure consistent performance in production.
Quality Metrics & Reporting
- Define and track KPIs.
- Test coverage (code, data, scenarios)
- Defect leakage rate
- Automation ROI (time saved vs. maintenance effort)
- Model accuracy thresholds
- Report risks and quality trends to stakeholders in sprint reviews.
- Drive adoption of AI-specific testing tools (e.g., LangChain for LLM testing, Great Expectations for data validation).
Soft Skills
- Strong problem-solving skills for balancing speed and quality in fast-paced AI development.
- Ability to communicate technical risks to non-technical stakeholders.
- Collaborative mindset to work with cross-functional teams (data scientists, ML engineers, DevOps).
Requirements:
Technical Requirements
Must-Have
-
10 years in test automation, with 2+ years validating AI/ML systems.
-
Expertise in: Automation tools: Selenium, Playwright, Cypress, REST Assured, Locust/JMeter
-
CI/CD: Jenkins, GitHub Actions, GitLab
-
AI/ML testing: Model validation, drift detection, GenAI output evaluation
-
Languages: Python, Java, or JavaScript
-
Certifications: ISTQB Advanced, CAST, or equivalent.
-
Experience with MLOps tools: MLflow, Kubeflow, TFX
-
Familiarity with vector databases (Pinecone, Milvus) and RAG workflows.
-
Strong programming/scripting experience in JavaScript, Python, Java, or similar
-
Experience with API testing, UI testing, and automated pipelines
-
Understanding of AI/ML model testing, output evaluation, and non-deterministic behavior validation
-
Experience with testing AI chatbots, LLM responses, prompt engineering outcomes, or AI fairness/bias
-
Familiarity with MLOps pipelines and automated validation of model performance in production
-
Exposure to Agile/Scrum methodology and tools like Azure Boards
Skills they ask for
Pick one to see other roles that ask for it.
About Dailoqa
Agentic AI for financial servicesDailoqa helps banks and financial services deploy its Broccoli agentic AI platform at enterprise scale.
See all 11 roles at DailoqaMore roles at Dailoqa
See all 11- Functional ExpertNoidaBusiness OperationsNoida, India1w
- AI/ML EngineerNoidaSoftware DevelopmentNoida, India1w
- Python DeveloperNoidaSoftware DevelopmentNoida, India1w
- AI/ML EngineerNoida · SeniorSoftware Development · SeniorNoida, India1w
Let the right jobs find you
In your inbox every Wednesday and SaturdayPersonalised suggestions from verified career pages, matched to your role, location, level and skills.