ETL Support Engineer

Job Description

We are looking for a proactive ETL Support Engineer with expertise in Snowflake, Matillion ETL, and cloud-based data pipelines, preferably with Banking Domain experience. The ideal candidate will be responsible for monitoring ETL jobs, troubleshooting failures, fixing data defects, and ensuring the smooth operation of data workflows in a cloud data warehouse environment. This role requires strong analytical skills, hands-on technical expertise, and the ability to collaborate with development and business teams to maintain data reliability and performance.

Key Responsibilities:

Job Monitoring & Incident Management:

• Monitor daily ETL workflows and Snowflake data pipelines to ensure timely and successful execution.
• Proactively identify job failures, performance bottlenecks, and data quality issues.
• Troubleshoot and resolve issues in Matillion ETL jobs and Snowflake queries.
• Coordinate with onshore/offshore teams to ensure support coverage and seamless handovers between Offshore and Onsite.

Defect Fixing & Root Cause Analysis:

• Analyze failed ETL jobs and data discrepancies to determine root causes.
• Fix data defects by modifying ETL logic, SQL scripts, or configuration settings.
• Work with data engineers to implement long-term fixes and prevent recurrence.
• Document defect resolution steps and maintain a knowledge base for common issues.

Data Validation & Reconciliation:

• Perform data reconciliation between source systems (on-prem) and cloud targets (Snowflake).
• Validate data accuracy across Bronze, Silver, and Gold layers of the Medallion architecture.

Collaboration & Communication:

• Work closely with data engineering, BI, and business analyst teams to understand data requirements and SLAs.
• Communicate job status, issues, and resolutions to stakeholders in a clear and timely manner.
• Raise data gaps in processes and present to relevant teams for resolution.

Process Improvement & Automation:

• Identify opportunities to automate manual monitoring and defect fixing tasks.
• Develop scripts (SQL/Python/Shell) to streamline validation and troubleshooting processes.
• Contribute to improving ETL job design for better reliability and maintainability.

Primary Skills:

• Strong hands-on experience with Snowflake Data Warehouse (SQL, query tuning, data validation).
• Hands-on experience with Matillion ETL or similar cloud ETL tools (monitoring, debugging, job fixes).
• Experience in ETL job monitoring and incident/defect management in production environments.
• Understanding of Medallion architecture (Bronze, Silver, Gold layers) and data flow across layers.
• Understanding and experience in raising Change Requests and track them to closure.
• Experience in any on-prem systems like SSIS/SSRS, Informatica and cloud systems.
• Familiarity with defect tracking and incident management tools (e.g., Jira, ServiceNow).
• Good understanding of cloud ecosystems (AWS/Azure/GCP) and their data services.
• Strong analytical and troubleshooting skills with attention to detail.
• Excellent communication and interpersonal skills.

Secondary Skills:

• Exposure to BI tools (e.g., Power BI, SSRS) for report validation.
• Familiarity with version control (e.g., Git) and CI/CD pipelines.
• Snowflake or Matillion certifications.
• Experience in Python or Shell scripting for automation and monitoring.
• Knowledge of banking domain data and compliance requirements.