Senior Backend Engineer
AIVAR Innovations
Let the right jobs find you
Get personalised suggestions from verified company career pages, matched to your role, location, level, and skills.
Overview
Position Type
Full Time
Experience
4+ years
Job Description
About Aivar Innovations
Aivar is an AI-first technology partner where cutting-edge technology meets industry expertise to supercharge your projects.
Team: Accelerators
Experience: 4–8 years | 2+ years building data-intensive pipelines
Technical Focus: Own accelerator's 6-n stage processing pipeline end-to-end: Ingestion to Output. Build the connectors, PII/PHI safety layer, compliance audit trail, and multi-tenant isolation. Pure platform engineering — async Python, event-driven architecture, enterprise-scale reliability.
Key Responsibilities:
- Design the core pipeline orchestration framework with async Python, supporting parallel/sequential stage execution with retry and dead-letter queues.
- Build the connector framework for 50+ enterprise data sources (APIs, databases, file systems, SaaS platforms).
- Implement safety validation — PII/PHI detection, data integrity checks, format compliance, input sanitisation.
- Build the reconstruction module — transforming extracted data into Markdown/vector representations and context maps.
- Design event-driven architecture with message queuing, backpressure handling, and graceful degradation.
- Implement immutable audit trail logging across all 6 stages — every decision, action, and transformation.
- Build multi-tenant data isolation, ensuring strict customer separation at every pipeline stage.
Must-Have Technical Skills:
- Distributed Python systems — asyncio, aiohttp, Celery; not scripting.
- Message queues/streaming — Kafka, SQS, RabbitMQ, or Redis Streams.
- High-volume data pipelines — 100K+ documents/records per batch.
- API design — REST/GraphQL, versioning, rate limiting, and auth.
- AWS services — Lambda, SQS/SNS, MSK, EKS, Step Functions, ECS/EKS, S3, DynamoDB, RDS.
- Multi-tenant SaaS architecture and customer data isolation patterns.
- Production habits — comprehensive testing, CI/CD, monitoring, and incident response.
Core Tech Stack:
Python, FastAPI, Celery, asyncio, Kafka/SQS/Redis Streams, PostgreSQL, DynamoDB, Redis, Elasticsearch, Terraform/CDK, Prometheus/Grafana/OpenTelemetry, GitHub Actions, Docker, AWS (Lambda, ECS, Step Functions, S3)