Jobs Companies Zaimler ML Infrastructure Engineer

About this ML Infrastructure Engineer role at Zaimler

Zaimler · Onsite · San Mateo, CA
About zaimler
 
AI agents can't reason over data they don't understand. Enterprise data today is fragmented across dozens of systems with no shared context, meaning, or structure, and that's why most enterprise AI is failing. The shift from copilots to autonomous agents is creating an entirely new infrastructure layer, and we're building it.
 
zaimler is the context infrastructure for the agentic era: a platform that automatically discovers domain knowledge, maps relationships, and gives AI agents the semantic understanding to operate with precision at scale. Imagine knowledge graphs that support real-time inference, built for systems that need to reason, not just retrieve.
 
zaimler was founded by Biswajit Das (ex-VP Engineering, Truera), a Data Infra veteran and former Chief Architect at Visa, and Sofus Macskassy (ex-Director of Engineering, LinkedIn), who built one of the largest knowledge graphs in production in the industry at LinkedIn. We're growing and deploying with major enterprises across insurance, travel, and technology. If you want to build infrastructure that the next decade of enterprise AI runs on, we'd love to talk.

About the Role

You'll own our inference and model-serving infrastructure end to end. This isn't a research role. It's a build role: you're setting up and scaling the systems that let our agents actually run in production, fast and reliably, at increasing concurrency.

You report to Sofus and work closely with our ML and infra teams.

What You’ll Own

  • Set up and scale inference/Ray Serve for ML and LLM model serving, integrated with our data analysis and agent workflows
  • Scale agent GPU infrastructure for concurrency and efficiency across multiple agent workloads
  • Optimize and improve the engine builder and model server that power scalable agent orchestration
  • What You Need

  • Proven ability to build scalable ML/AI platforms from scratch, end-to-end, for production use cases. You've owned a zero-to-one build before, or can show you're capable of it
  • Deep understanding of the inference stack: vLLM, KV cache, and the optimization layers underneath model serving
  • Experience building distributed systems for AI/ML workloads at scale, connecting them to real product or vertical integrations
  • 3+ years of relevant experience. We care about capability, not tenure
  • Nice to Have

  • Ray / Ray Serve experience
  • Familiarity with AIBrix
  • Why Join

  • A rare chance to shape both company and product direction as an early team engineer
  • Work alongside engineers and researchers from LinkedIn, Visa, Meta, and Branch
  • Onsite culture in San Mateo, built for deep collaboration and high-velocity building
  • Full benefits (medical, dental, vision, 401k)
  • We sponsor H-1B visas and assist with immigration

  • We value builders over résumés. If this role excites you but you don't check every box, we still want to hear from you. zaimler is an equal opportunity employer.
    Ready to apply to Zaimler?
    Apply to Zaimler

    Similar jobs

    Roblox
    Principal Machine Learning Infrastructure Engineer, Ads & Discovery
    Roblox
    ⚡ Apply early San Mateo, CA, United States Onsite $295,250–$345,040
    ● New 👁 Seen ✓ Applied 18h ago
    Roblox
    Senior Software Engineer - Data Infrastructure, Safety
    Roblox
    ⚡ Apply early San Mateo, CA, United States Onsite $196,750–$243,290
    ● New 👁 Seen ✓ Applied 18h ago
    Roblox
    Senior Hardware Engineer - Infrastructure
    Roblox
    ⚡ Apply early San Mateo, CA, United States Onsite $243,290–$295,250
    ● New 👁 Seen ✓ Applied 18h ago
    Verkada
    Staff Software Engineer, Identity & Access Management Platform
    Verkada
    ⚡ Apply early San Mateo, CA United States Onsite $200,000–$300,000
    ● New 👁 Seen ✓ Applied 2d ago
    PlayStation Global
    Software Engineer II, Client Platform
    PlayStation Global
    ⚡ Apply early United States, San Mateo, CA Onsite $163,000–$245,000
    ● New 👁 Seen ✓ Applied 2d ago
    Verkada
    Senior Backend Engineer - Device Platform
    Verkada
    ⚡ Apply early San Mateo, CA United States Onsite $190,000–$275,000
    ● New 👁 Seen ✓ Applied 4d ago
    Trust Wallet
    Senior Platform Engineer
    Trust Wallet
    ⚡ Apply early Worldwide
    ● New 👁 Seen ✓ Applied 1h ago
    Redwood Materials
    Infrastructure Software Engineer, Energy Storage
    Redwood Materials
    ⚡ Apply early San Francisco, California, Uni... Onsite $180,000–$237,500
    ● New 👁 Seen ✓ Applied 2h ago
    Stitch Fix
    ML Platform Engineer
    Stitch Fix
    ⚡ Apply early Remote, USA · location restricted $136,000–$167,000
    ● New 👁 Seen ✓ Applied 2h ago

    Sign up for suggestions tailored to the jobs you open and the searches you save.

    More jobs at Zaimler

    See all jobs at Zaimler →

    Apply now
    🤖

    Whoa — hold up

    JobsRadar was built for real people having a rough time in their job search — not for automated requests. You're clicking way too fast and you're now temporarily blocked.

    Come back later. If you're genuinely job hunting, we've got your back — just act like a human.

    Catch your next role the second it’s posted.

    Create a free account and we’ll watch the boards for you — the instant a job matches your search, it lands in your inbox or Telegram. No digging, no refreshing.

    Create free account

    Free forever · takes 30 seconds · already have one?

    Get an edge on your job hunt.

    Join our Telegram channel for the stuff that helps you land the role — salary benchmarks, the weekly market pulse, and new-feature drops. No spam, just signal.

    Join the channel — it's free