Data Engineering Lead

Description

GSPANN is hiring a Data Engineering Lead to build and optimize scalable cloud data platforms and pipelines, focusing on trusted, high-quality data and analytics solutions while guiding cross-functional teams.

Roles and Responsibilities

• Design and develop scalable Extract, Transform, Load (ETL) and Extract, Load, Transform (ELT) pipelines and cloud data platforms.
• Lead data warehouse and lakehouse implementations using Amazon Redshift or Databricks.
• Build and optimize data transformations using dbt, Spark, Python, and SQL.
• Implement data quality, governance, monitoring, and observability frameworks.
• Collaborate with cross-functional teams and provide technical leadership.

Skills and Experience

• Apply strong expertise in Amazon Redshift, dbt, Python, Apache Airflow, and Apache Spark to build scalable data platforms and analytics solutions.
• Bring experience with the AWS cloud ecosystem and services.
• Demonstrate knowledge of data mesh and modern data architecture principles.
• Work with real-time data processing and streaming architectures.
• Utilize Infrastructure as Code (IaC) tools such as Terraform and AWS CloudFormation.
• Bring experience working in Agile and Scrum environments.
• Demonstrate strong stakeholder management and leadership skills.