Integration Engineer

About Role:

We are seeking a highly skilled Senior Integration Engineer with 7-10 years of experience in data engineering, cloud technologies, and enterprise integration solutions. The ideal candidate will have strong expertise in AWS cloud services, Python, SQL, Databricks, workflow orchestration, and modern DevOps practices. This role requires the ability to independently analyze business requirements, identify gaps, develop robust data solutions, and build scalable data pipelines while collaborating with cross-functional teams.

Key Responsibilities:

• Design, develop, and maintain scalable and reliable data ingestion, transformation, and integration pipelines using Python and SQL.
• Build and manage cloud-native data solutions within the AWS ecosystem, leveraging services such as S3, EC2, IAM, and other relevant services.
• Develop, enhance, and maintain database migration frameworks using Alembic, ensuring seamless schema evolution with minimal downtime.
• Orchestrate, monitor, and optimize complex data workflows using Apache Airflow and Astronomer.
• Collaborate with product owners, data engineers, analysts, and business stakeholders to understand requirements and deliver production-grade solutions.
• Lead and support migration initiatives to Databricks, improving performance, scalability, and analytics capabilities.
• Create automated validation and testing frameworks using Python and AI-assisted testing tools/frameworks (e.g., Grok, AI-enabled testing platforms).
• Identify process gaps, recommend improvements, and independently design solutions to enhance system reliability and efficiency.
• Implement containerized applications using Docker and deploy workloads on Kubernetes to ensure scalability and high availability.
• Drive CI/CD implementation, code quality standards, release management, and infrastructure automation.
• Monitor system performance, troubleshoot production issues, and optimize cloud resources for cost and operational efficiency.
• Ensure adherence to security, governance, and best practices for cloud and data engineering platforms.

Required Qualifications:

• Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.
• 7-15 years of hands-on experience in Data Engineering, Cloud Engineering, or Integration Engineering roles.
• Proven experience designing and supporting enterprise-scale data platforms and integration solutions.
• Strong analytical, problem-solving, and troubleshooting skills.
• Experience working in Agile development environments and collaborating with cross-functional teams.
• Excellent communication and stakeholder management skills.

Mandatory Skills:

Cloud & Infrastructure

• AWS (S3, EC2, IAM, Lambda, CloudWatch preferred)
• Docker
• Kubernetes

Data Engineering

• Python
• Advanced SQL
• Data Pipeline Development
• ETL/ELT Processes
• Databricks

Workflow Orchestration

• Apache Airflow
• Astronomer

Database & Migration

• Database Design and Optimization
• Alembic
• Schema Migration Management

DevOps

• CI/CD Pipelines
• Git/GitHub/GitLab
• Code Quality & Release Management

Testing & Automation

• Python-based Test Automation
• AI-assisted Testing Frameworks (Grok or equivalent AI-powered testing platforms)

Good to Have Skills:

• PySpark and Spark Optimization
• AWS Glue
• Terraform or Infrastructure as Code (IaC)
• Kafka or Event-Driven Architectures
• Snowflake or Modern Data Warehouses
• REST API Development and Integration
• Monitoring Tools (Datadog, Prometheus, Grafana)
• Machine Learning and AI Integration Exposure
• Healthcare domain experience
• Experience with Large Language Models (LLMs) and AI-enabled automation frameworks

About Sonata Software:

Sonata Software is an AI-first modernization engineering company that helps enterprises transform legacy systems into intelligent, scalable business platforms. Powered by its Platformation™ framework and Harmoni.AI platform, Sonata delivers AI-led modernization across cloud, data, AI, Dynamics, test automation, and managed services. Headquartered in Bengaluru, India, Sonata has more than $1.2 billion in revenue and 6,400+ AI engineers supporting global delivery across regions including the US, UK, India, Malaysia, Mexico, Australia, DACH, and the Nordics. With deep partnerships across Microsoft, AWS, Salesforce, and Snowflake, Sonata helps Fortune 500 enterprises accelerate innovation, improve efficiency, and drive sustainable growth.

For more information, please visit www.sonata-software.com

Equal Opportunity:

Sonata Software is an Equal Opportunity Employer encouraging diversity in the workplace. All qualified applicants will receive consideration for employment without regard to race, national origin, gender identity, age, religion, disability, sexual orientation, veteran status, marital status, or any other characteristics protected by law