Data Engineer

PDI Technologies

Full Time8+ yearsPosted about 1 month ago

Let the right jobs find you

Get personalised suggestions from verified company career pages, matched to your role, location, level, and skills.

Overview

Position Type

Full Time

Experience

8+ years

Job Description

Role Overview:

As a Data Engineer IV, you will serve as a senior technical contributor responsible for designing, developing, and optimizing scalable cloud-based data solutions that enable enterprise analytics, reporting, and business intelligence. You will lead the delivery of complex data integration initiatives, establish engineering best practices, and provide technical guidance to other engineers. This role requires a strong understanding of modern data engineering practices and a conceptual understanding of data architecture principles to design scalable, maintainable, and governed data solutions while partnering with business and technology teams to solve complex business problems.

Key Responsibilities

  • Design, develop, and optimize scalable cloud-based data pipelines that support enterprise analytics, reporting, and business intelligence.
  • Lead the development of complex data integration solutions using AWS-native technologies and modern data engineering practices.
  • Design scalable data models, ingestion frameworks, and transformation processes that support reliable, high-quality analytics.
  • Apply data architecture principles when designing scalable, secure, and maintainable data pipelines, data models, and integration solutions.
  • Establish and promote engineering standards, reusable frameworks, and best practices that improve platform reliability, scalability, and maintainability.
  • Partner with business stakeholders to translate reporting and analytics requirements into technical solutions.
  • Drive continuous improvement through automation, infrastructure as code, CI/CD, and DevOps best practices.
  • Lead troubleshooting and resolution of complex data platform, integration, and performance issues.
  • Mentor and provide technical guidance to other data engineers through code reviews, knowledge sharing, and best practice adoption.
  • Evaluate emerging technologies and recommend improvements that enhance platform performance, scalability, security, and operational efficiency.
  • Support data governance initiatives by promoting data quality, metadata management, and engineering standards across the data platform.

Required Skills

AwsS3GlueRedshiftAp FlowLake FormationAws Step FunctionsSqlPythonPysparkEtl EltAi MlData QualityAnomaly DetectionDimensional Modeling

About the Company

PDI Technologies

Chennai, India

Share This Job