Performance Engineer
Bengaluru, India · Full-time
- Posted 5d ago
- From ZenteiQ’s careers page
- Location
- Bengaluru, India
- Type
- Full-time
- Experience
- 2+ years
- Department
- Engineering
Opens the listing on zenteiqai.keka.com
Let the right jobs find you
In your inbox every Wednesday and SaturdayPersonalised suggestions from verified career pages, matched to your role, location, level and skills.
About the role
About the Role
We are looking for a Performance Engineer, Inference to understand and improve the systems that serve our foundation models. Inference is a tightly coupled system spanning model execution, serving runtimes, distributed systems, accelerators, scheduling, memory, and reliability. You will measure the system end to end, identify the highest-leverage performance gaps, and work across teams to close them while preserving correctness.
Responsibilities
- Run cross-layer performance investigations across throughput, latency, memory efficiency, reliability, and cost.
- Build profiling, benchmarking, and observability tools that make inference performance measurable and explainable.
- Identify bottlenecks across model servers, batching and scheduling, distributed execution, memory systems, and accelerators.
- Partner with model, platform, and infrastructure teams to prioritize and land high-impact optimizations.
- Validate that performance improvements preserve model quality and numerical correctness.
Minimum Qualifications
- Hands-on experience profiling and optimizing ML systems or other performance-critical production systems.
- Production experience with at least one modern inference stack such as vLLM, SGLang, TensorRT-LLM, NVIDIA Dynamo, or an equivalent serving runtime.
- Experience serving or operating large models across accelerator-backed infrastructure, including multi-GPU or multi-accelerator systems.
- Strong Python skills and the ability to read, instrument, and modify large production codebases.
- Solid understanding of transformer inference, distributed systems, latency/throughput trade-offs, and accelerator performance fundamentals.
Preferred Qualifications
- Experience with large-scale or multi-node inference, including tensor, pipeline, data, or expert parallelism.
- Experience with GPUs, TPUs, NPUs, or other ML accelerators and associated profiling tools.
- Experience with quantization, low-precision inference, KV-cache optimization, speculative decoding, or long-context serving.
- Experience contributing to or modifying inference runtimes, kernels, compilers, or distributed serving components.
- Experience optimizing inference for constrained or on-device environments.
Skills they ask for
Pick one to see other roles that ask for it.
About ZenteiQ
Frontier AI for the physical worldZenteiQ builds foundation models from scratch in India and products that deploy them in industry, including in fully offline environments.
See all 9 roles at ZenteiQMore roles at ZenteiQ
See all 9- Product OwnerBengaluruProduct ManagementBengaluru, India5d
- Backend EngineerBengaluruSoftware DevelopmentBengaluru, India5d
- ML Systems EngineerBengaluruSoftware DevelopmentBengaluru, India5d
- Program ManagerBengaluru · Senior · On-siteProject and Program Management · Senior · On-siteBengaluru, India5d
Let the right jobs find you
In your inbox every Wednesday and SaturdayPersonalised suggestions from verified career pages, matched to your role, location, level and skills.