Companies Shakudo Infrastructure Engineer

About the role

Shakudo · Onsite
At Shakudo, we're building the world's first operating system for data and AI. We use the term "operating system" in the truest sense: just like iOS, Windows, or Linux, Shakudo's end-to-end OS provides ever-evolving, fully automated, best-in-class open-source components tailored to each business's unique needs.
 
We are seeking an Infrastructure Engineer to join our Business Automation team to own and operate the internal systems, infrastructure, and AI Gateway product that power Shakudo at scale. This is a hands-on role for someone who thrives on keeping production systems reliable, secure, and fast. You will be responsible for everything from physical servers and DGX machines to CI/CD pipelines and customer-facing AI Gateway infrastructure. You will also contribute directly to product hardening, security, and DevOps practices across the platform.
 
At Shakudo, our culture is proactive, collaborative, and supportive — we succeed together by building strong partnerships and solving complex challenges. We expect high ownership: you will be hands-on, driving outcomes directly rather than delegating or waiting for direction. Individual contribution matters here — your work will have a visible, measurable impact on the company's operations and product.

Key Responsibilities

  • Maintain and operate internal services for the rest of the Shakudo employees, including proprietary applications for sales and ETL pipelines
  • Maintain and operate DGX machines that host LLMs for the team's use
  • Maintain and operate Shakudo's product for Shakudo's internal use, and contribute to product hardening, security, and DevOps practices
  • Maintain and operate physical servers for Kubernetes clusters and ensure uptime
  • Create CI/CD pipelines for internal deployments
  • Maintain and operate the AI Gateway product for customers, ensure uptime, and contribute to product roadmap
  • Qualifications

  • 8+ years of experience across software, data, platform, or AI engineering roles
  • 5+ years of strong experience with Kubernetes cluster operation and DevOps, and bare-metal server operations
  • Experience operating production infrastructure at scale, including physical servers, GPU clusters, and CI/CD systems
  • Strong background in security hardening, observability, and reliability engineering
  • Proficiency in Rust is preferred
  • Experience with AI/ML infrastructure, including LLM hosting and inference serving is preferred 
  • Why Shakudo Stands Out

    Work with cutting-edge technologies in machine learning and high-performance computing. Contribute to a platform that transforms how organizations leverage data and AI. Join a dynamic team that values innovation, efficiency, and diversity.
     
    Shakudo offers a high-impact package: competitive salary, meaningful equity so you share in the upside of transformational technology, and comprehensive health benefits that have you fully covered. We provide a flexible vacation policy—because building transformational technology requires supporting the people who build it. More importantly, you'll work on technology that matters.
     
    This role is based onsite in Toronto to support the high security requirements of our clients and enable effective collaboration. We have a welcoming office environment with a very focused and passionate team, doing meaningful, impactful work together.
     
    Shakudo is an equal opportunity employer and encourages candidates of all backgrounds to apply. We foster diversity and inclusivity and welcome applications from a broad range of backgrounds and experiences.
    Ready to apply to Shakudo?
    Apply to Shakudo

    Similar jobs

    Faire
    Senior Staff Data Engineer - Platform Data and Analytics
    Faire
    ⚡ Apply early San Francisco, CA Onsite $268,000–$368,500
    ● New 👁 Seen ✓ Applied 1d ago
    Faire
    Senior Staff Data Engineer - Platform Data and Analytics
    Faire
    ⚡ Apply early Kitchener-Waterloo, ON; Toront... Onsite $228,000–$313,500
    ● New 👁 Seen ✓ Applied 1d ago
    Cloudflare
    Staff Software Engineer - Security Platform
    Cloudflare
    ⚡ Apply early Distributed; Hybrid Hybrid
    ● New 👁 Seen ✓ Applied 4d ago
    Rumble - Career Page
    Senior Platform Engineer - Security
    Rumble - Career Page
    ⚡ Apply early Washington D.C, Sarasota, Miam... Onsite $165,000–$205,000
    ● New 👁 Seen ✓ Applied 5d ago
    Rumble - Career Page
    Senior Platform Engineer (DBaaS)
    Rumble - Career Page
    ⚡ Apply early Washington D.C, Sarasota, Miam... Onsite $160,000–$185,000
    ● New 👁 Seen ✓ Applied 6d ago
    Waabi
    Platform Verification Engineer - Software Systems
    Waabi
    ⚡ Apply early San Francisco, CA Hybrid $133,650–$222,000
    ● New 👁 Seen ✓ Applied 1w ago
    Waabi
    Senior / Staff Machine Learning Infrastructure Engineer
    Waabi
    ⚡ Apply early Remote US & Canada · location restricted $157,000–$234,000
    ● New 👁 Seen ✓ Applied 1w ago
    Faire
    Senior Platform Analytics Engineer
    Faire
    ⚡ Apply early San Francisco, CA Onsite $196,000–$269,500
    ● New 👁 Seen ✓ Applied 1w ago
    Waabi
    Systems Engineer, Platform Requirements and Verification
    Waabi
    ⚡ Apply early Remote US · location restricted $140,000–$190,000
    ● New 👁 Seen ✓ Applied 2w ago

    Sign up for suggestions tailored to the jobs you open and the searches you save.

    Apply now
    🤖

    Whoa — hold up

    JobsRadar was built for real people having a rough time in their job search — not for automated requests. You're clicking way too fast and you're now temporarily blocked.

    Come back later. If you're genuinely job hunting, we've got your back — just act like a human.

    Catch your next role the second it’s posted.

    Create a free account and we’ll watch the boards for you — the instant a job matches your search, it lands in your inbox or Telegram. No digging, no refreshing.

    Create free account

    Free forever · takes 30 seconds · already have one?

    Get the worldwide-remote edge.

    Join our Telegram channel for the stuff that helps you land the role — salary benchmarks, the weekly market pulse, and new-feature drops. No spam, just signal.

    Join the channel — it's free