Staff Software Engineer - AI Compute, Together Cloud

Together AI·San Francisco·Posted 23 September 2026

Apply with a tailored CV View on Together AI's site

About the role

About the Role Together AI is building the AI Native Cloud, an end-to-end platform for the full generative AI lifecycle, combining the fastest LLM inference engine with state-of-the-art GPU cloud infrastructure. The Together Cloud team builds the [Together GPU Clusters](https://www.together.ai/gpu-clusters) flagship IaaS product that provides high-performance, AI-ready GPU clusters through a self-serve cloud console, along with the virtualized infrastructure layer powering Together's inference, RL, and fine-tuning products. As a Staff Software Engineer focusing on AI Compute in the Together Cloud org, you will set technical direction for and build major components of the next generation AI cloud platform – a highly available, global cloud infrastructure with cutting-edge virtualization of the latest ML hardware: GB300s/VRs, BlueField DPUs, InfiniBand and dual/quad-plane RoCEv2 fabrics. That virtualized computing platform powers our own SaaS products – inference, RL, and fine-tuning – and serves external cloud customers through self-serve offerings such as on-demand/reserved Kubernetes/Slurm clusters, across dozens of data centers and hundreds of thousands of GPUs. This is an…

This is a summary of the advert. The full description and the application are on Together AI's careers site.

Apply faster with Prepper

A version of your CV tailored to this Staff Software Engineer - AI Compute, Together Cloud role.
A cover letter written from your CV and this advert.
Prepper can fill in Together AI's application form and send it once you approve.
The application saved in your tracker, with reminders to follow up.

Start free

More roles at Together AI

Prepper is independent and not affiliated with Together AI. Roles are listed from the employer's public careers system and removed when they close.