Engineering Manager, Kubernetes Bare Metal Infrastructure
Together AI·San Francisco·Posted 10 November 2026
About the role
About The Role We are hiring an Engineering Manager/Tech Lead Manager to lead the team that runs Kubernetes on bare-metal GPU infrastructure at Together AI. You will own how thousands of GPUs across our data centers are provisioned, orchestrated and kept healthy for the customers training, fine-tuning and serving models on our platform. Together AI is the AI Native Cloud: a full-stack platform for running open and custom generative AI models, from GPU clusters to serverless inference. Our research and engineering teams contribute widely used open-source work such as FlashAttention, and our infrastructure runs at the frontier of GPU hardware. This team sits at the base of that stack. Every training run, inference endpoint and customer cluster depends on the reliability, utilization and speed of the bare-metal Kubernetes layer you will lead. Responsibilities Own the bare-metal Kubernetes platform Set the technical direction for how we run Kubernetes on bare metal across multiple data centers and regions. Drive automated, zero-touch provisioning of GPU nodes, from firmware and OS imaging through cluster join and validation. Own cluster lifecycle at scale: upgrades, capacity…
This is a summary of the advert. The full description and the application are on Together AI's careers site.
Apply faster with Prepper
- A version of your CV tailored to this Engineering Manager, Kubernetes Bare Metal Infrastructure role.
- A cover letter written from your CV and this advert.
- Prepper can fill in Together AI's application form and send it once you approve.
- The application saved in your tracker, with reminders to follow up.
More roles at Together AI
- Senior Web & Inbound Growth ManagerSan Francisco
- Strategic Account Executive Inference IndiaIndia
- Sr. Field Marketing & Community ManagerNew York
- Sr. Field Marketing & Community Manager, EMEALondon
- Event & Field Marketing SpecialistSan Francisco
- (Senior/Junior AI Inference Reliability Engineer, Compute InfraSan Francisco
- Senior Recruiter, G&ASan Francisco
- Technical Writer Intern, Developer Experience (Summer 2027)San Francisco
Prepper is independent and not affiliated with Together AI. Roles are listed from the employer's public careers system and removed when they close.