Prepper
Start freePricing

Staff Software Engineer, Inference / Compute Infrastructure Engineering London or Amsterdam

Together AI·London & Amsterdam·Posted 20 August 2026

Apply with a tailored CV View on Together AI's site

About the role

About the Role We're looking for a software engineer to build the Kubernetes-native control plane that provisions and runs our GPU inference fleet. You'll design a manifest-driven API where the inference team declares what they need, whether that's a cluster, a model deployment, or a capacity change, and our controllers handle the reconciliation, provider/runtime selection, and lifecycle management underneath, so the inference team never has to know or care which specific serving stack, scheduler, or hardware pool is doing the work. You'll also build the systems that keep the fleet efficient, not just running, including defragmentation and rebalancing logic that consolidates scattered workloads back into contiguous capacity, and scheduling/bin-packing improvements that push GPU utilization up without hurting latency. The core value we're after is decoupling the people building on top of the platform from the operational and runtime complexity underneath, while squeezing more usable capacity out of the same hardware. You'll build the controllers, reconciliation loops, and self-service surface (API/CLI, not tickets) that make that decoupling real, plus the event-driven health,…

This is a summary of the advert. The full description and the application are on Together AI's careers site.

Apply faster with Prepper

  • A version of your CV tailored to this Staff Software Engineer, Inference / Compute Infrastructure Engineering London or Amsterdam role.
  • A cover letter written from your CV and this advert.
  • Prepper can fill in Together AI's application form and send it once you approve.
  • The application saved in your tracker, with reminders to follow up.
Start free

More roles at Together AI

Prepper is independent and not affiliated with Together AI. Roles are listed from the employer's public careers system and removed when they close.