Prepper

Senior AI Evals Engineer

Rubrik Job Board·Bangalore·Posted 15 October 2026

About the role

About the Role The Senior AI Evals Test Engineer is a hands-on technical role responsible for defining, developing, and executing robust evaluation frameworks and test strategies for AI agents built using the Google Agent Development Kit (ADK) or similar sort of agentic frameworks . This role bridges AI development and reliable deployment — ensuring our agents are safe, ethical, effective, and meet high-quality performance standards. A significant focus of the role is on Responsible AI and Safety Evals, including adversarial testing, red-teaming, bias detection, and toxicity measurement . The engineer will design scalable evaluation pipelines , build synthetic test environments, and work closely with AI/ML Engineers, Researchers, and policy teams to ensure agents are production-ready and compliant with regulatory and ethical standards. The role is 70% Automation and 30% Manual Testing , and sits within the Applied AI: Test Engineering team as a key technical authority. Key Responsibilities Design and build agent evaluation frameworks — create end-to-end infrastructure for evaluating LLM-based agents across correctness, latency, cost, safety, and task completion rate Build…

This is a summary of the advert. The full description and the application are on Rubrik Job Board's careers site.

Apply faster with Prepper

  • A version of your CV tailored to this Senior AI Evals Engineer role.
  • A cover letter written from your CV and this advert.
  • Prepper can fill in Rubrik Job Board's application form and send it once you approve.
  • The application saved in your tracker, with reminders to follow up.
Start free

More roles at Rubrik Job Board

Prepper is independent and not affiliated with Rubrik Job Board. Roles are listed from the employer's public careers system and removed when they close.