P1 - GP - Senior QA Engineer – Data (Databricks)
Bengaluru, India · Hybrid
- Posted 1w ago
- From Atlas Systems’s careers page
- Location
- Bengaluru, India
- Work mode
- Hybrid
- Level
- Senior
- Experience
- 6+ years
- Department
- Quality Assurance
Opens the listing on atlas.bamboohr.com
Let the right jobs find you
In your inbox every Wednesday and SaturdayPersonalised suggestions from verified career pages, matched to your role, location, level and skills.
About the role
Senior QA Engineer – Data (Databricks)
About the Role
The Senior QA Engineer for Data will test and validate the data platform behind our internal back-office systems, including Databricks pipelines and the Power BI reports that business users rely on. This is a hands-on senior role: you'll make sure our data is accurate, complete, and timely, build automated data tests, and mentor onshore and nearshore QA testers. You'll partner closely with data engineers and business stakeholders and work within an agile environment.
Responsibilities
- Design and carry out test strategies for data pipelines built in Databricks, covering ingestion, transformation, and output.
- Validate data accuracy, completeness, and consistency between sources and targets, including reconciliation and data comparison processes.
- Build and maintain automated data tests in Python and Pytest, using SQL and PySpark to validate tables and transformations.
- Test and validate Power BI reports against source data.
- Define and implement data quality checks, and help set QA standards for the data platform.
- Integrate data tests into CI/CD pipelines.
- Investigate data defects and pipeline performance issues, and coordinate fixes with data engineering.
- Work with business users to understand how they use data and reports, and propose technical and non-technical solutions to business problems.
- Mentor onshore and nearshore QA testers, and review their test code against coding standards.
- Track and report on data quality metrics, test coverage, and release readiness.
- Stay current on QA tools and practices, including AI-assisted testing.
Required Qualifications
- 6+ years of QA experience, including 3+ years testing data pipelines, data warehouses, or analytics platforms.
- Hands-on experience testing in Databricks.
- Strong SQL skills for data validation and reconciliation.
- Proficiency in Python and Pytest.
- Experience with PySpark or Spark SQL.
- Solid understanding of ETL/ELT processes and data modeling concepts.
- Experience testing in cloud environments (Azure preferred).
- Experience with a test management tool (Qase preferred).
- Experience working in an agile environment.
- Strong process discipline and attention to detail.
- Excellent verbal and written communication skills, with a customer-service mindset toward business users.
Preferred Qualifications
- Experience testing or validating Power BI reports.
- Experience with Delta Lake and Unity Catalog.
- Experience with data quality frameworks (e.g., Great Expectations or Databricks pipeline expectations).
- Experience with CI/CD pipelines (e.g., Azure DevOps).
- Experience mentoring QA testers or working with distributed or nearshore teams.
- Familiarity with AI-assisted development tools such as Claude Code.
Current Tech Stack
Python, Pytest, SQL, PySpark, Databricks, Power BI, Qase, Azure, Claude Code
Skills they ask for
Pick one to see other roles that ask for it.
About Atlas Systems
AI software and managed servicesAtlas Systems develops software for provider management, third-party risk management and AI-enabled business workflows.
See all 12 roles at Atlas SystemsMore roles at Atlas Systems
See all 12- Senior / Lead Full-Stack Developer (React PWA / Node.js / .NET)Bengaluru · Senior · On-siteSoftware Development · Senior · On-siteBengaluru, India2d
- P1 - GP - Senior Data Engineer / Data ArchitectBengaluru · Senior · On-siteEngineering · Senior · On-siteBengaluru, India3d
- Implementation ManagerBengaluru · On-siteProject and Program Management · On-siteBengaluru, India1w
- P1 - GP - Senior DeveloperBengaluru · Senior · HybridSoftware Development · Senior · HybridBengaluru, India1w
Let the right jobs find you
In your inbox every Wednesday and SaturdayPersonalised suggestions from verified career pages, matched to your role, location, level and skills.