Jobs › Companies › Ifm Us › Machine Learning Engineer — GPU Kernel

About this Machine Learning Engineer — GPU Kernel role at Ifm Us

Ifm Us · Onsite · Sunnyvale, CA

About the Institute of Foundation Models

We are a dedicated research lab for building, understanding, using, and risk-managing foundation models. Our mandate is to advance research, nurture the next generation of AI builders, and drive transformative contributions to a knowledge-driven economy.

As part of our team, you’ll have the opportunity to work on the core of cutting-edge foundation model training, alongside world-class researchers, data scientists, and engineers, tackling the most fundamental and impactful challenges in AI development. You will participate in the development of groundbreaking AI solutions that have the potential to reshape entire industries. Strategic and innovative problem-solving skills will be instrumental in establishing MBZUAI as a global hub for high-performance computing in deep learning, driving impactful discoveries that inspire the next generation of AI pioneers.

The Role

The GPU Kernel Engineer will play a role at the forefront of optimizing performance for the machine learning software stacks, especially at training and inference, and support the team to develop new and cutting-edge systems. The ideal candidate will have a strong background in parallel computing, and hands-on experience in system level coding, debug methodologies, and large-scale machine learning experience.

This role focuses on CUDA kernel development and optimization. Distributed training experience is a plus.

Key Responsibilities

  • Understand, analyze, profile, optimize, and provide guidance to the team on deep learning workloads on state-of-the-art hardware and software platforms to improve their efficiency with different levels of optimization
  • Design and implement performance benchmarks and testing methodologies to evaluate application performance
  • Build tools to automate workload analysis, workload optimization, and other critical workflows
  • Triage system issues and identify bottleneck and inefficiencies by analyzing the sources of issues and the impact on hardware, network and propose solutions to enhance GPU utilization
  • Support the team to develop appropriate kernels and systems for new model architectures and algorithms
  • Participate in, or lead design reviews with peers and stakeholders to decide amongst available technologies.
  • Review code developed by other developers and provide feedback to ensure best practices (e.g., style guidelines, checking code in, accuracy, testability, and efficiency).
  • Contribute to existing documentation or educational content and adapt content based on product/program updates and user feedback.
  • Represent MBZUAI at industry conferences and events, showcasing the institution’s cutting-edge HPC and deep learning capabilities and establishing MBZUAI as a global leader in AI research and innovation.
  • Perform all other duties as reasonably directed by the line manager that are commensurate with these functional objectives.
  • Validate CUDA kernel outputs and gradients against reference implementations, and benchmark representative shapes, dtypes, and model workloads.
  • Technical Qualifications

    Must-Haves:

  • Strong C++ skills and hands-on CUDA kernel development and optimization for deep-learning workloads.
  • Understanding of GPU memory hierarchy, warp/block execution, and compute-memory trade-offs, with demonstrated profiling-driven optimization.
  • Strong Python skills and experience integrating kernels with PyTorch or an equivalent framework, including numerical and gradient validation where needed.
  • Nice-to-Haves:

  • Experience with Triton, CUTLASS, or PTX/SASS analysis.
  • Experience with multi-node distributed training or inference systems.
  • Experience validating mixed-precision computations, such as BF16 or FP8.

  • Compensation

    $150,000 – $450,000/year + discretionary performance bonus + benefits

    The posted salary range represents the company’s good faith estimate of the base compensation for this position upon hire. The actual base compensation offered may vary within this range depending on individual qualifications, including but not limited to relevant skills, experience, education, certifications, and specific business needs. In addition to base salary, total compensation includes an annual discretionary performance bonus and comprehensive benefits.

    Benefits Include

    • Comprehensive medical, dental, and vision benefits
    • Bonus
    • 401K Plan
    • Generous paid time off, sick leave and holidays
    • Paid Parental Leave
    • Employee Assistance Program
    • Life insurance and disability
    Ready to apply to Ifm Us?
    Apply to Ifm Us

    How this ML Engineer salary compares

    This role pays $300,000/yr — above the typical range for ML Engineer roles.

    $161,300 median $251,400 $312,500

    Typical range $192,500–$300,000/yr, from 21 comparable ML Engineer listings on JobsRadar (pay annualized to USD). See ML Engineer salary insights →

    Similar jobs

    CoreWeave
    Senior Applied ML Engineer
    CoreWeave
    ⚡ Apply early Bellevue, WA / Sunnyvale, CA Onsite $182,000–$242,000
    ● New 👁 Seen ✓ Applied 1d ago
    CoreWeave
    Senior Software Engineer, ML Workflows - Weights & Biases
    CoreWeave
    ⚡ Apply early Livingston, NJ / New York, NY... Onsite $165,000–$220,000
    ● New 👁 Seen ✓ Applied 1d ago
    DoorDash USA
    Senior Machine Learning Engineer, New Verticals Agentic Foundations
    DoorDash USA
    ⚡ Apply early San Francisco, CA; Sunnyvale,... Onsite $167,800–$246,800
    ● New 👁 Seen ✓ Applied 2d ago
    DoorDash USA
    Senior Machine Learning Engineer, Drive
    DoorDash USA
    ⚡ Apply early San Francisco, CA; Sunnyvale,... Onsite $137,100–$201,600
    ● New 👁 Seen ✓ Applied 2d ago
    DoorDash USA
    Senior Software Engineer, ML Serving Platform
    DoorDash USA
    ⚡ Apply early San Francisco, CA; Sunnyvale,... Onsite $167,800–$246,800
    ● New 👁 Seen ✓ Applied 1w ago
    Apptronik
    Staff Software Engineer, ML
    Apptronik
    ⚡ Apply early Sunnyvale, CA Onsite $285,000–$340,000
    ● New 👁 Seen ✓ Applied 2w ago
    Ifm Us
    Machine Learning Engineer — Reinforcement Learning
    Ifm Us
    ⚡ Apply early Sunnyvale, CA Onsite $150,000–$450,000
    ● New 👁 Seen ✓ Applied 3w ago
    Ifm Us
    Machine Learning Engineer – World Model
    Ifm Us
    ⚡ Apply early Sunnyvale, CA Onsite $150,000–$450,000
    ● New 👁 Seen ✓ Applied 3w ago
    Accenture
    AI / ML Computational Engineer
    Accenture
    ⚡ Apply early Pune Onsite
    ● New 👁 Seen ✓ Applied 3h ago

    Sign up for suggestions tailored to the jobs you open and the searches you save.

    More jobs at Ifm Us

    See all jobs at Ifm Us →

    Apply now
    🤖

    Whoa — hold up

    JobsRadar was built for real people having a rough time in their job search — not for automated requests. You're clicking way too fast and you're now temporarily blocked.

    Come back later. If you're genuinely job hunting, we've got your back — just act like a human.

    Catch your next role the second it’s posted.

    Create a free account and we’ll watch the boards for you — the instant a job matches your search, it lands in your inbox or Telegram. No digging, no refreshing.

    Create free account

    Free forever · takes 30 seconds · already have one?

    Get an edge on your job hunt.

    Join our Telegram channel for the stuff that helps you land the role — salary benchmarks, the weekly market pulse, and new-feature drops. No spam, just signal.

    Join the channel — it's free