Data Engineer

Job Summary:

Wissen Technology is hiring a Senior Data Engineer to build and maintain scalable cloud-based data platforms. The role focuses on product development, data engineering, analytics enablement, data pipeline automation, and platform optimization using Azure data technologies for enterprise-grade solutions.

Experience:

8-10 years

Location:

Bangalore

Mode of Work:

Hybrid

Mandatory Skills (Must Have):

• Azure Databricks (8+ years building and optimizing large-scale data processing solutions)
• Azure Data Factory for enterprise ETL/ELT orchestration and workflow automation
• PySpark for large-scale distributed data engineering and transformation
• Azure Data Lake for storage, governance, and data lifecycle management
• Azure Synapse Analytics for data warehousing and analytics workloads
• Delta Tables and Delta Lake architecture for reliable data pipelines
• Unity Catalog for data governance, access management, and metadata management
• Python and SQL for data engineering, automation, and advanced data transformations

Optional Skills (Good to Have):

• Serverless Compute architecture on Azure
• Data visualization and analytics product development
• API development for data services and analytics platforms
• CI/CD implementation in Azure DevOps
• Experience with data quality, monitoring, and observability frameworks

Professional Attributes and Qualifications:

• Education: BE in Computer Science, Engineering, Information Technology, or related field
• Leadership: Experience mentoring junior data engineers and promoting engineering best practices
• Ownership: Ability to drive end-to-end data platform initiatives independently
• Strong analytical, troubleshooting, and problem-solving capabilities
• Excellent written and verbal communication skills with cross-functional teams and stakeholders

Key Responsibilities:

• Design, develop, and maintain scalable data pipelines using Azure Databricks, PySpark, and Azure Data Factory
• Partner with data architects to support the full data lifecycle including acquisition, cleansing, integration, analytics, and visualization
• Build and optimize Delta Tables and Azure Data Lake solutions for enterprise data platforms
• Develop automated data processing services, APIs, and analytics products
• Implement data governance and security controls using Unity Catalog
• Optimize data warehouse and analytics workloads using Azure Synapse Analytics
• Perform code reviews, testing, monitoring, and troubleshooting to ensure data platform reliability
• Collaborate with business stakeholders and engineering teams to deliver high-quality data solutions