AI Infrastructure Systems Engineer

Together AI·San Francisco·Posted 15 May 2026

Apply with a tailored CV View on Together AI's site

About the role

About the Role At Together AI, you’ll build and operate one of the world’s largest GPU fleets used for frontier model training and inference. This isn’t a traditional infrastructure role—we’re looking for engineers who love building systems, automating everything, and solving problems at massive scale. If you enjoy writing software more than clicking dashboards, obsess over eliminating manual work, and want to build infrastructure that manages tens of thousands of GPUs autonomously, we’d love to talk. Responsibilities Design and build fleet automation systems that provision, validate, deploy, upgrade, repair, and retire GPU clusters with minimal human intervention. Build AI Infrastructure Agents that automate deployment, root-cause failures, incident triage, and autonomous remediation. Develop Fleet Intelligence platforms that continuously monitor hardware health, firmware, networking, storage, thermals, and workload performance to predict failures before they impact customers. Build software that maximizes GPU availability, utilization, performance, and reliability across thousands of accelerators. Create automated validation systems for GPUs, InfiniBand/RoCE fabrics,…

This is a summary of the advert. The full description and the application are on Together AI's careers site.

Apply faster with Prepper

A version of your CV tailored to this AI Infrastructure Systems Engineer role.
A cover letter written from your CV and this advert.
Prepper can fill in Together AI's application form and send it once you approve.
The application saved in your tracker, with reminders to follow up.

Start free

More roles at Together AI

Prepper is independent and not affiliated with Together AI. Roles are listed from the employer's public careers system and removed when they close.