Jobs › Companies › Shakudo › Infrastructure Engineer

About this Infrastructure Engineer role at Shakudo

Shakudo · Onsite · Toronto, ON
At Shakudo, we're building the world's first operating system for data and AI. We use the term "operating system" in the truest sense: just like iOS, Windows, or Linux, Shakudo's end-to-end OS provides ever-evolving, fully automated, best-in-class open-source components tailored to each business's unique needs.
 
We are seeking an Infrastructure Engineer to join our Business Automation team to own and operate the internal systems, infrastructure, and AI Gateway product that power Shakudo at scale. This is a hands-on role for someone who thrives on keeping production systems reliable, secure, and fast. You will be responsible for everything from physical servers and DGX machines to CI/CD pipelines and customer-facing AI Gateway infrastructure. You will also contribute directly to product hardening, security, and DevOps practices across the platform.
 
At Shakudo, our culture is proactive, collaborative, and supportive — we succeed together by building strong partnerships and solving complex challenges. We expect high ownership: you will be hands-on, driving outcomes directly rather than delegating or waiting for direction. Individual contribution matters here — your work will have a visible, measurable impact on the company's operations and product.

Key Responsibilities

  • Maintain and operate internal services for the rest of the Shakudo employees, including proprietary applications for sales and ETL pipelines
  • Maintain and operate DGX machines that host LLMs for the team's use
  • Maintain and operate Shakudo's product for Shakudo's internal use, and contribute to product hardening, security, and DevOps practices
  • Maintain and operate physical servers for Kubernetes clusters and ensure uptime
  • Create CI/CD pipelines for internal deployments
  • Maintain and operate the AI Gateway product for customers, ensure uptime, and contribute to product roadmap
  • Qualifications

  • 8+ years of experience across software, data, platform, or AI engineering roles
  • 5+ years of strong experience with Kubernetes cluster operation and DevOps, and bare-metal server operations
  • Experience operating production infrastructure at scale, including physical servers, GPU clusters, and CI/CD systems
  • Strong background in security hardening, observability, and reliability engineering
  • Proficiency in Rust is preferred
  • Experience with AI/ML infrastructure, including LLM hosting and inference serving is preferred 
  • Why Shakudo Stands Out

    Work with cutting-edge technologies in machine learning and high-performance computing. Contribute to a platform that transforms how organizations leverage data and AI. Join a dynamic team that values innovation, efficiency, and diversity.
     
    Shakudo offers a high-impact package: competitive salary, meaningful equity so you share in the upside of transformational technology, and comprehensive health benefits that have you fully covered. We provide a flexible vacation policy—because building transformational technology requires supporting the people who build it. More importantly, you'll work on technology that matters.
     
    This role is based onsite in Toronto to support the high security requirements of our clients and enable effective collaboration. We have a welcoming office environment with a very focused and passionate team, doing meaningful, impactful work together.
     
    Shakudo is an equal opportunity employer and encourages candidates of all backgrounds to apply. We foster diversity and inclusivity and welcome applications from a broad range of backgrounds and experiences.
    Ready to apply to Shakudo?
    Apply to Shakudo

    Similar jobs

    Clutch Technologies Inc.
    Staff Platform Engineer
    Clutch Technologies Inc.
    ⚡ Apply early Toronto, ON Onsite $200,000–$200,000
    ● New 👁 Seen ✓ Applied 2h ago
    Credit Genie
    Staff Software Engineer, Financial Platform
    Credit Genie
    ⚡ Apply early New York, NY Onsite $200,000–$250,000
    ● New 👁 Seen ✓ Applied 17h ago
    Canadian Tire
    Platform Engineer, Transportation Systems
    Canadian Tire
    ⚡ Apply early Toronto, ON Onsite $80,000–$131,000
    ● New 👁 Seen ✓ Applied 1d ago
    CR
    Senior Software Engineer, Backend - Platform Team
    Cresta
    ⚡ Apply early Canada (Remote); Toronto, Cana... Hybrid
    ● New 👁 Seen ✓ Applied 2d ago
    Cloudflare
    Senior Software Engineer - Security Platform
    Cloudflare
    ⚡ Apply early Distributed Onsite $194,000–$266,000
    ● New 👁 Seen ✓ Applied 2d ago
    Credit Genie
    Senior Platform Infrastructure Engineer
    Credit Genie
    ⚡ Apply early Plymouth Meeting, PA Onsite $170,000–$225,000
    ● New 👁 Seen ✓ Applied 4d ago
    Epiq
    Principal AI Platform Engineer
    Epiq
    ⚡ Apply early CAN-Toronto-ON-200 Bay Street,... Onsite CA$150,000–CA$150,000
    ● New 👁 Seen ✓ Applied 2w ago
    BMO
    Senior Platform Engineer, AI & Fabrics
    BMO
    ⚡ Apply early Toronto, ON, CAN Hybrid $70,000–$150,000
    ● New 👁 Seen ✓ Applied 2w ago
    Faire
    Staff Data Infrastructure Engineer
    Faire
    ⚡ Apply early Kitchener-Waterloo, ON; Toront... Hybrid $216,000–$297,000
    ● New 👁 Seen ✓ Applied 2w ago

    Sign up for suggestions tailored to the jobs you open and the searches you save.

    More jobs at Shakudo

    See all jobs at Shakudo →

    Apply now
    🤖

    Whoa — hold up

    JobsRadar was built for real people having a rough time in their job search — not for automated requests. You're clicking way too fast and you're now temporarily blocked.

    Come back later. If you're genuinely job hunting, we've got your back — just act like a human.

    Catch your next role the second it’s posted.

    Create a free account and we’ll watch the boards for you — the instant a job matches your search, it lands in your inbox or Telegram. No digging, no refreshing.

    Create free account

    Free forever · takes 30 seconds · already have one?

    Get an edge on your job hunt.

    Join our Telegram channel for the stuff that helps you land the role — salary benchmarks, the weekly market pulse, and new-feature drops. No spam, just signal.

    Join the channel — it's free