Inference Software Engineer

Etched·San Jose·Posted 17 June 2025

Apply with a tailored CV View on Etched's site

About the role

About Etched Etched is building hardware for frontier intelligence. We co-design chips, racks, software, and manufacturing to deliver best-in-class throughput and latency across both prefill and decode workloads. Our first products are heavily focused on inference. Backed by hundreds of millions from top-tier investors and staffed by leading engineers, Etched is redefining the infrastructure layer for the fastest growing industry in history. Key responsibilities - Support porting state-of-the-art models to our architecture. Help build programming abstractions and testing capabilities to rapidly iterate on model porting. - Build, enhance, and scale our runtime, including multi-node inference, intra-node execution, state management, and robust error handling. - Optimize routing and communication layers using our collectives. - Utilize performance profiling and debugging tools to identify bottlenecks and correctness issues. You may be a good fit if you have - Proficiency in C++ or Rust. - Understanding of performance-sensitive or complex distributed software systems like Linux internals, accelerator architectures (e.g. GPUs, TPUs), Compilers, or high-speed…

This is a summary of the advert. The full description and the application are on Etched's careers site.

Apply faster with Prepper

A version of your CV tailored to this Inference Software Engineer role.
A cover letter written from your CV and this advert.
Prepper can fill in Etched's application form and send it once you approve.
The application saved in your tracker, with reminders to follow up.

Start free

More roles at Etched

Prepper is independent and not affiliated with Etched. Roles are listed from the employer's public careers system and removed when they close.