Prepper

Member of Technical Staff (Site Reliability Engineer, Crawler)

Perplexity·London·Posted 13 November 2026

About the role

Keeping a crawler running is not the same as keeping it productive. Queues can grow while servers look healthy, and a small change can become a fleet-wide bottleneck. On Perplexity's Crawler team, you'll improve throughput, plan capacity, and build operational reliability through safer deployments, better observability, and durable fixes. Responsibilities - Operate and optimize Kubernetes workloads and supporting infrastructure for crawler services, including fetching and rendering fleets. - Build and maintain infrastructure as code and CI/CD pipelines, with safe rollouts, validation, and fast rollback. - Define SLOs and build monitoring, alerting, and observability for availability, latency, throughput, and resource saturation. - Own capacity planning and resource efficiency; diagnose queue backlogs, network failures, and resource bottlenecks with service owners. - Participate in the team's on-call rotation, lead incident response, and turn blameless postmortems into durable reliability improvements. - Write production software to automate diagnosis and routine remediation, with validation and approval gates for high-impact actions. Qualifications - 5+ years…

This is a summary of the advert. The full description and the application are on Perplexity's careers site.

Apply faster with Prepper

  • A version of your CV tailored to this Member of Technical Staff (Site Reliability Engineer, Crawler) role.
  • A cover letter written from your CV and this advert.
  • Prepper can fill in Perplexity's application form and send it once you approve.
  • The application saved in your tracker, with reminders to follow up.
Start free

More roles at Perplexity

Prepper is independent and not affiliated with Perplexity. Roles are listed from the employer's public careers system and removed when they close.