Staff Software Engineer, Inference / Compute Infrastructure Engineering
Bengaluru, India · Remote · Full-time
- Posted 1mo ago
- From Together AI’s careers page
- Location
- Bengaluru, India
- Work mode
- Remote
- Type
- Full-time
- Level
- Staff
- Department
- Engineering
Opens the listing on job-boards.greenhouse.io
Let the right jobs find you
In your inbox every Wednesday and SaturdayPersonalised suggestions from verified career pages, matched to your role, location, level and skills.
About the role
We're looking for a Software Engineer to build the systems that treat infrastructure as software. This role owns the software state machines that provision hardware, bring it into service, and manage its full lifecycle — turning racks of GPUs into running inference clusters without a human touching a runbook. The Research and Inference team is your customer: today they file tickets and wait; the target state is that they issue a single API call to stand up, scale, or tear down a cluster, and the system takes care of the rest. The platform is manifest-driven such that teams declare the desired state of a cluster or host — shape, topology, software stack — and the system is responsible for reconciling reality to that manifest, continuously, through every stage of its lifecycle. You will design the engines that manifest the schema, the engines that execute against it, and the workflows that carry a piece of hardware or a cluster from one state to the next—taking it from bare metal to a fully functioning AI cluster for training or inference.
You'll write production code which is typed, tested, versioned, and deployed through CI/CD that models infrastructure state and reconciles it, the same way a Kubernetes controller reconciles a cluster's desired state. Success looks like eliminating manual provisioning work, not documenting it better.
A product mindset - you've built internal platforms or APIs consumed by other engineering teams and care about the developer experience of what you ship.You build it, you own it. You are not only responsible for delivering the software but also for operating and supporting it in production.
Remote in India
Skills they ask for
Pick one to see other roles that ask for it.
About Together AI
Cloud infrastructure for open-source AITogether AI provides cloud infrastructure, models, inference, and tools for developing and running AI applications.
See all 57 roles at Together AIMore roles at Together AI
See all 57- Sr. Partnerships Manager, US Model LabsSan Francisco · SeniorSales · SeniorSan Francisco, United States3d
- Senior Partner Marketing ManagerSan Francisco · Senior · HybridMarketing · Senior · HybridSan Francisco, United States4d
- Field Marketing & Community ManagerSan FranciscoMarketingSan Francisco, United States4d
- Senior Recruiter, GTM & BusinessSan Francisco · SeniorHuman Resources · SeniorSan Francisco, United States2w
Let the right jobs find you
In your inbox every Wednesday and SaturdayPersonalised suggestions from verified career pages, matched to your role, location, level and skills.