Data Engineer
India · Full-time
- Posted 1mo ago
- From Indus Net Technologies’s careers page
- Location
- India
- Type
- Full-time
- Experience
- 5+ years
- Department
- Software Development
Opens the listing on indusnet.freshteam.com
Let the right jobs find you
In your inbox every Wednesday and SaturdayPersonalised suggestions from verified career pages, matched to your role, location, level and skills.
About the role
Job Title: Data Engineer
Experience: 5–10 Years. Location: Pan India Joining Time: Immediate to 15 Days Maximum
About the Role:
Indus Net Technologies is looking for an experienced Data Engineer to design, build, and maintain robust data pipelines leveraging Databricks and Azure Cloud Services. The ideal candidate will have hands-on expertise in processing large-scale IoT sensor data from manufacturing equipment, ensuring data quality, integrity, and high performance across multi-plant operations.
Key Responsibilities:
- Design and implement ETL/ELT pipelines using Databricks and PySpark.
- Process and transform real-time IoT sensor data from multiple manufacturing plants.
- Manage data storage, versioning, and optimization using Delta Lake.
- Integrate data from diverse sources (SQL Server, JSON, CSV, APIs, etc.).
- Write and optimize complex SQL queries and stored procedures for performance.
- Implement data quality monitoring, testing, and CI/CD pipelines using Azure DevOps.
- Collaborate closely with manufacturing and analytics teams to deliver actionable IoT data insights.
Top 4 Mandatory Skills:
- Databricks & Apache Spark (PySpark) – Minimum 3 years of hands-on experience
- Azure Cloud Services – Experience with ADF, Blob Storage, and DevOps
- Python – Advanced proficiency with OOP concepts, pandas, and robust error handling
- Delta Lake – Strong knowledge of data versioning, time travel, and optimization
Good-to-Have Skills:
- Advanced SQL and stored procedure development
- Experience in JSON data processing and schema handling
- Git-based version control and CI/CD integration using Azure DevOps
- Exposure to manufacturing or industrial IoT data patterns
Preferred Domain Knowledge:
- Industrial IoT and time-series data management
- Machine data and equipment performance monitoring
- Multi-plant data integration and central data architecture
- Data quality frameworks, downtime, and defect analytics
Qualifications:
- Bachelor’s degree in Computer Science, Engineering, or a related field
- 4–6 years of proven experience in Data Engineering
- 2+ years of strong exposure to Databricks/Spark ecosystem
- Azure Data Engineer Associate or Databricks certification is preferred
Soft Skills:
- Excellent communication skills in English (written and verbal)
- Strong analytical and problem-solving mindset
- Collaborative and proactive approach with cross-functional teams
- High attention to detail and commitment to data accuracy
Skills they ask for
Pick one to see other roles that ask for it.
About Indus Net Technologies
Digital transformation and cloud solutionsINT Global delivers digital transformation, cloud and analytics solutions that help businesses scale.
See all 9 roles at Indus Net TechnologiesMore roles at Indus Net Technologies
See all 9- Full Stack DeveloperKolkata · SeniorSoftware Development · SeniorKolkata, India1mo
- Business RepresentativeKolkataSalesKolkata, India1mo
- Tableau DeveloperKolkataData and AnalyticsKolkata, India1mo
- Consulting Business PartnerMumbai · SeniorSales · SeniorMumbai, India1mo
Let the right jobs find you
In your inbox every Wednesday and SaturdayPersonalised suggestions from verified career pages, matched to your role, location, level and skills.