Staff+ Software Engineer, Safeguards Evals

About the role

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the role How do we know whether a model is safe - and how do we know whether the systems we built to catch misuse actually catch it? Anthropic answers both questions with evaluations. We measure model behavior across misuse, prompt injection, and user well-being to inform training and deployment decisions. We also use AI to investigate potential misuse of Claude, analyzing real-world traffic to surface bad actors and emerging threats that drive enforcement actions. Neither is worth much unless the evaluations behind them are representative, robust, and trustworthy. This role builds the methods and infrastructure that make them so. Sitting at the intersection of applied ML research and engineering, you'll design experiments to improve how we evaluate both model behavior and the agentic systems that govern it, build datasets that represent real…

This is a summary of the advert. The full description and the application are on Anthropic's careers site.

More roles at Anthropic

• Technical Program Manager, PacingSan Francisco, CA | New York City, NY
• Technical Program Manager, External EvaluatorsSan Francisco, CA | New York City, NY
• Partner Account Manager, Systems IntegratorsTokyo, Japan
• International Infrastructure AccountingDublin, IE
• Partnerships Enablement Specialist, JapanTokyo, Japan
• Engineering Manager, Agent Security PartnershipsNew York City, NY | Seattle, WA; San Francisco, CA | New York City, NY
• Product Manager, Seller ExperienceSan Francisco, CA | New York City, NY
• Security Engineer, RF and Technical Surveillance CountermeasuresSan Francisco, CA | New York City, NY