Member of Technical Staff (Site Reliability Engineer, Crawler)
Perplexity·London·Posted 13 November 2026
About the role
Keeping a crawler running is not the same as keeping it productive. Queues can grow while servers look healthy, and a small change can become a fleet-wide bottleneck. On Perplexity's Crawler team, you'll improve throughput, plan capacity, and build operational reliability through safer deployments, better observability, and durable fixes. Responsibilities - Operate and optimize Kubernetes workloads and supporting infrastructure for crawler services, including fetching and rendering fleets. - Build and maintain infrastructure as code and CI/CD pipelines, with safe rollouts, validation, and fast rollback. - Define SLOs and build monitoring, alerting, and observability for availability, latency, throughput, and resource saturation. - Own capacity planning and resource efficiency; diagnose queue backlogs, network failures, and resource bottlenecks with service owners. - Participate in the team's on-call rotation, lead incident response, and turn blameless postmortems into durable reliability improvements. - Write production software to automate diagnosis and routine remediation, with validation and approval gates for high-impact actions. Qualifications - 5+ years…
This is a summary of the advert. The full description and the application are on Perplexity's careers site.
Apply faster with Prepper
- A version of your CV tailored to this Member of Technical Staff (Site Reliability Engineer, Crawler) role.
- A cover letter written from your CV and this advert.
- Prepper can fill in Perplexity's application form and send it once you approve.
- The application saved in your tracker, with reminders to follow up.
More roles at Perplexity
- Engineering Manager, SecuritySan Francisco
- Member of Technical Staff (Web Access Engineer, Crawler)London
- Head of Marketing OperationsSan Francisco
- Growth GTM Engineer, Revenue OperationsSan Francisco
- Lead Product Designer, Growth (Mobile)San Francisco
- Lead Product Designer, Mobile (Native & Mobile)San Francisco
- Product Manager, LegalSan Francisco
- Go-To-Market Compensation LeadSan Francisco
Prepper is independent and not affiliated with Perplexity. Roles are listed from the employer's public careers system and removed when they close.