Jobs › Companies › Perplexity › Member of Technical Staff (Index Engineer, Search Crawler)

À propos de ce poste Member of Technical Staff (Index Engineer, Search Crawler) chez Perplexity

Perplexity · Sur site · London

AI answers are only as trustworthy as the information behind them. Perplexity grounds its answers in fresh, real-world sources, and the index is what makes that possible. We're looking for an engineer to work on the indexing and data processing layer of Perplexity's Search Crawler. You'll build systems that ingest, process, and organize large volumes of crawled content into efficient, queryable structures, working primarily on offline and nearline pipelines that keep data fresh, complete, and accessible to downstream retrieval. Throughput, scalability, and correctness are critical across datasets that change continuously.

Responsibilities

  • Design, implement, and operate large-scale indexing systems and data pipelines at the core of Perplexity's search infrastructure.

  • Develop and optimize indexing strategies that balance performance, freshness, and resource efficiency.

  • Work on storage formats, compaction, and update mechanisms that keep data accessible and current.

  • Keep pipelines reliable and predictable under high-throughput conditions.

  • Build well-tested components with clear responsibilities and interface contracts that stay flexible as the system evolves.

  • Define and implement observability across offline and near line pipelines, including structured logs, metrics, and data quality signals.

  • Monitor throughput, resource usage, and cost, and drive optimisations as business needs change.

  • Partner with retrieval, ranking, and ML teams to make sure indexing outputs meet their requirements.

  • Enable safe experimentation on indexing strategies and processing logic through controlled rollouts and clearly defined quality signals.

Qualifications

  • 5+ years of experience building production backend or data infrastructure systems.

  • Strong programming experience in Go, C++, or Rust.

  • Experience with high-throughput data processing systems and very large datasets.

  • Experience building or operating databases, storage systems, data planes, or indexing pipelines.

  • Strong understanding of distributed systems, fault tolerance, consistency, and scalability.

  • Experience running production systems and handling operational incidents.

  • A systems-thinking mindset and the ability to reason about end-to-end data flows.

Prêt à postuler chez Perplexity ?
Postuler chez Perplexity

Emplois similaires

Perplexity
Member of Technical Staff (Cybersecurity Solutions Architect)
Perplexity
⚡ Postuler tôt San Francisco Hybride $250,000–$350,000
● Nouveau 👁 Vu ✓ Postulé il y a 10 min
Perplexity
Member of Technical Staff (Enterprise Security Engineer)
Perplexity
⚡ Postuler tôt San Francisco Hybride $250,000–$350,000
● Nouveau 👁 Vu ✓ Postulé il y a 10 min
Perplexity
Member of Technical Staff (Software Engineer, Fraud Prevention)
Perplexity
⚡ Postuler tôt London Hybride
● Nouveau 👁 Vu ✓ Postulé il y a 10 min
Perplexity
Member of Technical Staff (Software Engineer, Enterprise Trust & Governance)
Perplexity
⚡ Postuler tôt San Francisco Sur site $220,000–$405,000
● Nouveau 👁 Vu ✓ Postulé il y a 10 min
Perplexity
Member of Technical Staff (Search Core, Indexing & Data Pipeline Stream)
Perplexity
⚡ Postuler tôt Belgrade Sur site
● Nouveau 👁 Vu ✓ Postulé il y a 10 min
Perplexity
Member of Technical Staff (Offensive Security Engineer)
Perplexity
⚡ Postuler tôt San Francisco Hybride $220,000–$405,000
● Nouveau 👁 Vu ✓ Postulé il y a 10 min
Perplexity
Member of Technical Staff (Software Engineer, Security)
Perplexity
⚡ Postuler tôt San Francisco Sur site $220,000–$405,000
● Nouveau 👁 Vu ✓ Postulé il y a 10 min
Perplexity
Member of Technical Staff (Software Engineer, Cybersecurity Products)
Perplexity
⚡ Postuler tôt San Francisco Sur site $220,000–$405,000
● Nouveau 👁 Vu ✓ Postulé il y a 10 min
Perplexity
Engineering Manager (Security)
Perplexity
⚡ Postuler tôt San Francisco Hybride $300,000–$405,000
● Nouveau 👁 Vu ✓ Postulé il y a 10 min

Inscrivez-vous pour des suggestions adaptées aux emplois que vous ouvrez et aux recherches que vous enregistrez.

Plus d’emplois chez Perplexity

Voir tous les emplois chez Perplexity →

Postuler maintenant
🤖

Doucement — un instant

JobsRadar a été conçu pour de vraies personnes qui traversent une période difficile dans leur recherche d’emploi — pas pour des requêtes automatisées. Vous cliquez beaucoup trop vite et vous êtes maintenant temporairement bloqué.

Revenez plus tard. Si vous cherchez réellement un emploi, nous sommes de votre côté — agissez simplement comme un être humain.

Catch your next role the second it’s posted.

Create a free account and we’ll watch the boards for you — the instant a job matches your search, it lands in your inbox or Telegram. No digging, no refreshing.

Create free account

Free forever · takes 30 seconds · already have one?

Prenez une longueur d’avance dans votre recherche d’emploi.

Rejoignez notre canal Telegram pour ce qui vous aide à décrocher le poste — références salariales, le pouls hebdomadaire du marché et les annonces de nouveautés. Pas de spam, que du signal.

Rejoindre le canal — c’est gratuit