Jobs › Companies › Traversal › Principal Engineer, Data Platform

About this Principal Engineer, Data Platform role at Traversal

Traversal · Onsite · New York

About Traversal

Traversal is the AI Site Reliability Engineer (AI SRE) for the enterprise.

Production complexity was already outpacing what engineering teams could manage manually, and AI-generated code is accelerating that gap. Traversal is built for that challenge, autonomously understanding and reasoning across even the largest, most complex production environments to diagnose, fix, and prevent incidents. Our mission is to free engineers from endless firefighting and give them more time to focus on creative, high-impact work.

Today, Traversal operates in mission-critical environments at some of the world’s largest enterprises, including PepsiCo, Nubank, Harvey, and DigitalOcean. Our roots remain deeply embedded in AI research, and we’ve brought together researchers from institutions including MIT, Harvard, Berkeley, Columbia, and Cornell with world-class technical staff and operators from companies like Google, Meta, Datadog, ServiceNow, and Citadel Securities to take on one of the hardest problems for AI to solve. Traversal is backed by Sequoia Capital, Kleiner Perkins, Redpoint Ventures, and Khosla Ventures.

The Role

The Traversal AI SRE agent's performance and accuracy are hugely dependent on the data it reasons over. When Traversal investigates a production incident at a Fortune 100 company, we rely on having the right data, in the right shape, in the right place, and at the right time, to deliver the best and fastest outcomes to our customers. This is the crucially important role of Traversal's Production World Model™ and petabyte-scale data platform: hundreds of billions of log lines a day from a single customer, ingested at hundreds of megabytes per second, and queryable by the agent within minutes of being emitted.

We're hiring a Principal Engineer, Data Platform, to own the technical direction of that platform. You'll define how data enters Traversal, how it's stored and queried, and how it's transformed into the derived products our agents and researchers rely on — across SaaS and BYOC deployments in some of the most demanding enterprise environments in the world.

This is a hands-on technical leadership role: you'll shape roadmaps and write the design docs that set the direction, write the code that proves it out, and raise the bar for the engineers who build alongside you.

This is also a rare seat where data infrastructure meets frontier AI. The agent is the platform's most demanding customer, and AI Research is its closest partner. You'll see firsthand how an AI agent reasons over production data, and your decisions will directly shape how well it does. At our stage, a Principal Engineer doesn't work from a ticket queue. You'll work directly with leadership on what we build and why, sit in front of our largest customers, and learn how an enterprise AI company is built from the inside.

What You'll Do

  • Own the data platform architecture. Define the long-term architecture across our four data paths — direct push ingestion, scheduled pulls from third-party observability platforms, non-telemetry data, and transformation pipelines — including the interfaces, invariants, and evolution path that let them scale together.

  • Set the storage and query strategy. Decide what our storage layer looks like at 10–100x today's scale: time-series, columnar/OLAP, and lakehouse tradeoffs; retention and cost; performance commitments for the agent's key queries.

  • Serve the agent as a first-class workload. An AI agent is the platform's most demanding consumer. Design the query interfaces it depends on: performance commitments for its key tool queries, freshness guarantees for the data it reasons over, and safe sandboxing for the ad-hoc queries an LLM will inevitably write.

  • Build the data foundation for AI research. Work side by side with our AI Research team to give the agent and its auto-research loops the data they need: investigation history, evaluation datasets, and the derived signals that make the agent measurably better. You'll learn how a production AI agent is built, evaluated and improved, and you'll see your data decisions show up in its accuracy.

  • Shape the company, not just the platform. Work directly with engineering and company leadership on the technical roadmap and how it serves the business. Join architecture reviews and deployments with Fortune 100 customers. Bring what you learn from Product, Forward Deployed Engineering and Go-to-Market back into what we build.

  • Build the orchestration and transformation backbone. Lead the framework for scheduled, idempotent, observable jobs that ingest non-telemetry context and produce derived data — materialized views, rollups, entity graphs, and LLM-based summarization and enrichment that's cached ahead of investigations rather than computed during them.

  • Own reliability, performance, and cost end to end. Define and meet SLOs for availability, data freshness, and query latency; build systems that ship with their monitoring, runbooks, and safe rollouts; and lead the technical response when things break.

  • Govern customer data. Design redaction, tenant isolation, and data-residency controls that satisfy the security and compliance teams of the world's largest banks, payment companies, and tech companies.

  • Multiply the team. Mentor senior engineers, and set standards and reference implementations that teams beyond Data Platform adopt.

What We're Looking For

  • Senior-level depth in building and operating data infrastructure in production (typically 10+ years), including a track record of setting architecture for a data platform used by multiple teams.

  • Deep distributed-systems expertise in streaming data, analytical storage, and query engines: Kafka (or equivalent), ClickHouse/Doris/Druid/Pinot, data lakehouse technologies, and building scalable and reliable multi-tenant data systems.

  • Strong systems programming in Rust (our primary data platform language) or comparable experience in Go, plus comfort in Python.

  • Experience shipping on Kubernetes, Helm, Terraform, and AWS, ideally into environments you don't fully control (BYOC, on-prem, or regulated customer clouds).

  • A record of leading multi-quarter migrations and platform transformations through to adoption and deprecation, not just design.

  • You still write production code regularly, and can walk us through recent work you personally shipped.

  • Sound cost judgment: you reason about tradeoffs between performance, cost, durability, and simplicity with real numbers, and you know what your systems cost to run.

  • Clear technical writing and judgment: you can make a crisp tradeoff call, get alignment without authority, and hold your own in an architecture review with an enterprise customer.

Nice to Have

  • Experience building the backend of an observability, logging, APM, or SIEM product.

  • Fluency with OpenTelemetry/OTLP and the data models and APIs of major observability vendors (Datadog, Splunk, Elastic, Prometheus, Dynatrace).

  • Experience with workflow orchestration (Airflow, Dagster, Temporal) and data pipeline frameworks.

  • Experience building LLM-powered data pipelines: enrichment, summarization, embeddings, and controlling their cost.

  • Background in data governance: PII redaction, data residency, and regulated industries such as financial services.

  • Contributions to open-source data infrastructure.

Compensation

We offer competitive compensation, startup equity, health insurance, and additional benefits. The U.S. base salary range for this full-time, in-person role in New York is $275,000 to $350,000 USD, plus equity and benefits. Our salary ranges are based on location, level, and role. Individual compensation is determined by experience, skills, and job-related knowledge.

Why You Should Join Us

If you've mastered data infrastructure and want to be at the center of AI, rather than next to it, this is the role.

Traversal is a place to take on hard, meaningful problems with real ownership from day one. You’ll work alongside people who challenge you to grow, learn constantly, and help define a new category of infrastructure software. We think long term, move quickly, and hold a high bar without taking ourselves too seriously.

We offer competitive salary and equity packages, health insurance, fertility benefits, a great tech setup stipend and flexible time off. Plus in-office snacks, team happy hours and outings, an annual company offsite, and plenty of built in time to collaborate across teams.

Traversal is fully in-office, 5 days a week, based in New York near Madison Square Park. We have a collaborative, hard-working culture and are energized by building the future of AI-powered software maintenance.

Ready to apply to Traversal?
Apply to Traversal

How this Principal Engineer salary compares

This role pays $312,500/yr — above the typical range for Principal Engineer roles.

$117,745 median $213,031 $331,950

Typical range $161,765–$272,500/yr, from 158 comparable Principal Engineer listings on JobsRadar (pay annualized to USD). See Principal Engineer salary insights →

Similar jobs

Ion
Principal iOS Engineer, New York
Ion
⚡ Apply early New York Onsite
● New 👁 Seen ✓ Applied 52m ago
AR
Principal GTM Engineer
Artemis
⚡ Apply early New York City Onsite $180,000–$260,000
● New 👁 Seen ✓ Applied 1d ago
CoreWeave
Principal Software Engineer - Models
CoreWeave
⚡ Apply early San Francisco, CA, Bellevue, W... Onsite $227,000–$303,000
● New 👁 Seen ✓ Applied 1d ago
CoreWeave
Principal Engineer, Distributed Systems
CoreWeave
⚡ Apply early New York, NY / Sunnyvale, CA Onsite $227,000–$303,000
● New 👁 Seen ✓ Applied 1d ago
SignalFire
Principal Software Engineer - VC Backed Startups
SignalFire
⚡ Apply early NYC - Hybrid Hybrid $170,000–$270,000
● New 👁 Seen ✓ Applied 1d ago
SignalFire
Principal AI/ML Engineer - VC Backed Startups
SignalFire
⚡ Apply early NYC - Hybrid Hybrid $170,000–$270,000
● New 👁 Seen ✓ Applied 1d ago
Northrop Grumman
Systems Engineer/Principal Systems Engineer
Northrop Grumman
⚡ Apply early United States-New York-Bethpag... Onsite $94,000–$141,500
● New 👁 Seen ✓ Applied 1d ago
GlobalFoundries
Principal Engineer SiPh Device
GlobalFoundries
⚡ Apply early USA - New York - Malta Onsite $85,000–$146,000
● New 👁 Seen ✓ Applied 1d ago
ERM
Principal Consultant, Engineer or Scientist - Sustainable Operations
ERM
⚡ Apply early Rochester, New York Onsite $127,600–$163,100
● New 👁 Seen ✓ Applied 1d ago

Sign up for suggestions tailored to the jobs you open and the searches you save.

More jobs at Traversal

See all jobs at Traversal →

Apply now
🤖

Whoa — hold up

JobsRadar was built for real people having a rough time in their job search — not for automated requests. You're clicking way too fast and you're now temporarily blocked.

Come back later. If you're genuinely job hunting, we've got your back — just act like a human.

Catch your next role the second it’s posted.

Create a free account and we’ll watch the boards for you — the instant a job matches your search, it lands in your inbox or Telegram. No digging, no refreshing.

Create free account

Free forever · takes 30 seconds · already have one?

Get an edge on your job hunt.

Join our Telegram channel for the stuff that helps you land the role — salary benchmarks, the weekly market pulse, and new-feature drops. No spam, just signal.

Join the channel — it's free