Senior Software Engineer — Infra Agent Systems
Together AI·San Francisco·Posted 10 September 2026
About the role
About the Role Together AI runs one of the largest GPU fleets in the world. The Infra Agent Systems team builds the software systems that power and automate that infrastructure. We develop production AI agents that diagnose hardware failures, investigate incidents, correlate signals across the fleet, and automate operational workflows. Alongside these agents, we build the platform they run on, including knowledge graphs, retrieval systems, orchestration frameworks, and developer tooling. You’ll work across two areas: Infrastructure Agent Systems — Build production AI agents that help operate our GPU fleet by diagnosing failures, investigating incidents, gathering evidence from live systems, and assisting with remediation. These agents are used every day by our infrastructure and datacenter teams through APIs, CLI, dashboards, and Slack. Core Agent Platform — Build the platform that powers these agents, including knowledge graphs, search and retrieval, orchestration, evaluation, and the tooling that enables agents to reason, act, and continuously improve. We’re working on something that hasn’t really been done before: building knowledge graphs and self-improving AI agents that…
This is a summary of the advert. The full description and the application are on Together AI's careers site.
Apply faster with Prepper
- A version of your CV tailored to this Senior Software Engineer — Infra Agent Systems role.
- A cover letter written from your CV and this advert.
- Prepper can fill in Together AI's application form and send it once you approve.
- The application saved in your tracker, with reminders to follow up.
More roles at Together AI
- Engineering Manager, Kubernetes Bare Metal InfrastructureSan Francisco
- Senior Web & Inbound Growth ManagerSan Francisco
- Strategic Account Executive Inference IndiaIndia
- Sr. Field Marketing & Community ManagerNew York
- Sr. Field Marketing & Community Manager, EMEALondon
- Event & Field Marketing SpecialistSan Francisco
- (Senior/Junior AI Inference Reliability Engineer, Compute InfraSan Francisco
- Senior Recruiter, G&ASan Francisco
Prepper is independent and not affiliated with Together AI. Roles are listed from the employer's public careers system and removed when they close.