Research Intern, Inference (Summer 2027)

Together AI·San Francisco·Posted 18 September 2026

Apply with a tailored CV View on Together AI's site

About the role

About The Role The Inference Research team is dedicated to building the next generation of efficient, scalable, and reliable serving systems for large foundation models, directly contributing to the mission of advancing open and transparent AI. Our work operates at the critical intersection of cutting-edge model architectures, high-performance systems engineering, and deep hardware optimization. We focus on co-designing software, algorithms, and models to significantly lower the cost and latency of modern AI systems. As a research intern, you will dive into the complexities of distributed inference, compiler-aware optimization, and novel inference-time computation strategies (such as speculative decoding and phase-aware execution). You will be tasked with co-designing and implementing cross-layer optimizations across models, systems, and hardware, with a focus on areas like KV cache design and large-scale serving architectures. Projects aim to unlock unprecedented performance and scale for foundation models, enabling faster serving, larger model deployment (e.g., Mixture-of-Experts), and robust, reproducible evaluation under realistic serving workloads. Responsibilities Design and…

This is a summary of the advert. The full description and the application are on Together AI's careers site.

Apply faster with Prepper

A version of your CV tailored to this Research Intern, Inference (Summer 2027) role.
A cover letter written from your CV and this advert.
Prepper can fill in Together AI's application form and send it once you approve.
The application saved in your tracker, with reminders to follow up.

Start free

More roles at Together AI

Prepper is independent and not affiliated with Together AI. Roles are listed from the employer's public careers system and removed when they close.