Senior Data Engineer

Main Purpose of Job

The Senior Data Engineer designs, builds and maintains the data ingestion and transformation pipelines that populate Inchcape’s central data platforms. This role ingests raw data from diverse systems, curates the bronze and silver layers of the medallion architecture, ensures data quality and performance, and delivers reliable, reusable datasets for modelling, analysis, reporting and BI.

Key Accountabilities

• Develop and maintain ETL/ELT pipelines to ingest data from ERP, CRM, operational, financial, and third-party sources into the Microsoft Fabric Platform - Lakehouse (OneLake) using Delta Lake/Parquet.
• Implement data quality standards and controls, incremental loading, CDC and error handling to ensure reliability and correctness.
• Create bronze tables, curated Silver and gold tables by transforming, cleansing and conforming raw data, document lineage and transformations.
• Optimise performance through partitioning, clustering and tuning of MS Fabric, SQL and Spark workloads, monitor pipeline health and costs.
• Collaborate with Data Architects, Modellers and Data BAs to design schemas, naming conventions and integration patterns to ensure business self-service enablement through Gold data.
• Build reusable components, templates and automation scripts using Fabric Dataflows Gen2, Spark notebooks or equivalent tools.
• Maintain metadata and sensitivity labels via Purview, ensure proper access controls and compliance.
• Research and evaluate new features and patterns in Microsoft Fabric and make recommendations for adoption, enabling an AI-driven data strategy.
• Introduce the most economic, optimised technique in the data integration space to reduce total operational cost.
• Ensure NFR requirements like resilience, availability and security standards are applied as per agreed NFR metrics.

Key Deliverables

• Automated, documented ingestion pipelines with monitoring and alerting.
• High-quality conforming bronze, silver and gold data assets that are ready for self-service.
• Performance benchmarks and tuning reports demonstrating efficient resource usage.
• Contribution to ingestion templates, best practice guides and knowledge sharing.
• Low-Level Designs for data pipelines and other data integration-related assets.

Essential

• 8+ years in data engineering or data integration roles, working with SQL, Python and or Scala.
• Experience of ETL/ELT patterns, CDC, incremental loading and data warehousing principles using Microsoft Fabric.
• Practical experience with Delta Lake, Lakehouse/Medallion architecture and cloud data platforms (Azure and AWS).
• Proficient in building pipelines with tools like MS Fabric Dataflows Gen2, Spark/SQL notebooks or equivalent.
• Experienced in data quality frameworks and monitoring/observability tools.
• Ability to collaborate across teams and communicate technical concepts to non-engineers.

Desirable

• Experience with streaming data (Kafka, Event Hubs) or real-time ingestion.
• Knowledge of master data management and data governance practices.
• Familiarity with version control and CI/CD for data pipelines.
• Experience in, and assisted in, the implementation of governance, controls, and standards.
• Any Shipping or Maritime experience
• Big Data Ecosystem prior experience is a plus.

Educational & Professional Qualification:

Essential

• Bachelor’s degree in computer science, engineering or related discipline.
• Certification in Azure Data Engineering is a MUST.

Desirable

• Certifications in AWS cloud data platform or other data platform.

Plus much more!

Why Inchcape Shipping Services?

We believe in building a diverse and high-performing workforce that works together to provide our customers with the exceptional service they deserve. To reach the highest standards, we depend on our people, their welfare, training, and expertise. We realize the value of our staff and know that your unique experiences, skills, and passions will help you to build a rich and rewarding career in our dynamic industry.

Our values are at the centre of everything we do, and the successful candidate will be expected to demonstrate and fully adopt these:

• Global Perspective - We connect the world and see the bigger picture.
• The Power of People - we rely on the strength of local agent knowledge and relationships.
• Progress - we adopt new thinking and push for positive change in our industry.

Inchcape is an Equal Opportunities Employer - equality, diversity, and inclusion are at the heart of everything we do. Working in a diverse society, we recognise that our customers, colleagues, and contractors are central to our success.

Additional Information:

• Appointment to this role will be subject to satisfactory references and possession of a valid Right to Work documentation, depending upon your geographical location.
• To protect the interests of all parties, Inchcape will not accept unsolicited or speculative resumes from recruitment agencies and will not be responsible for any fees associated with them.