Prepper

Engineering Manager, Kubernetes Bare Metal Infrastructure

Together AI·San Francisco·Posted 10 November 2026

About the role

About The Role We are hiring an Engineering Manager/Tech Lead Manager to lead the team that runs Kubernetes on bare-metal GPU infrastructure at Together AI. You will own how thousands of GPUs across our data centers are provisioned, orchestrated and kept healthy for the customers training, fine-tuning and serving models on our platform. Together AI is the AI Native Cloud: a full-stack platform for running open and custom generative AI models, from GPU clusters to serverless inference. Our research and engineering teams contribute widely used open-source work such as FlashAttention, and our infrastructure runs at the frontier of GPU hardware. This team sits at the base of that stack. Every training run, inference endpoint and customer cluster depends on the reliability, utilization and speed of the bare-metal Kubernetes layer you will lead. Responsibilities Own the bare-metal Kubernetes platform Set the technical direction for how we run Kubernetes on bare metal across multiple data centers and regions. Drive automated, zero-touch provisioning of GPU nodes, from firmware and OS imaging through cluster join and validation. Own cluster lifecycle at scale: upgrades, capacity…

This is a summary of the advert. The full description and the application are on Together AI's careers site.

Apply faster with Prepper

  • A version of your CV tailored to this Engineering Manager, Kubernetes Bare Metal Infrastructure role.
  • A cover letter written from your CV and this advert.
  • Prepper can fill in Together AI's application form and send it once you approve.
  • The application saved in your tracker, with reminders to follow up.
Start free

More roles at Together AI

Prepper is independent and not affiliated with Together AI. Roles are listed from the employer's public careers system and removed when they close.