Jobs Companies Julius AI Software Engineer - Infrastructure (Mid - Senior)

About this Software Engineer - Infrastructure (Mid - Senior) role at Julius AI

Julius AI · Onsite · San Francisco, CA

Compensation: Competitive base salary and meaningful equity

Benefits: Health & dental insurance, gym reimbursement, daily team meals, commuter benefits

We’re an applied AI lab building coding agents. Julius executes ~1M lines of code every 36 hours for 1M+ users and has generated 3M+ visualizations. All code runs in code sandboxes (isolated remote containers) that we manage. We’re revenue‑generating and backed by AI Grant, YCombinator, Bessemer Venture Partners and the founders from Vercel, Notion, Perplexity, Palantir, Replit, Zapier, Intercom, and Dropbox.

The Role

Build and scale the code‑execution sandboxes that power Julius across cloud environments (AWS and GCP). We orchestrate 500k+ containers/month and growing. You’ll own reliability, performance, and security for multi‑tenant compute.

What You’ll Do

  • Design and operate secure, multi‑tenant container infrastructure with fast startup and smart autoscaling.

  • Ship cloud deployments (Helm/Terraform) with SSO, network controls, and audit logging.

  • Drive observability (metrics, traces, logs) with clear SLOs; lead incident response.

  • Optimize images, scheduling, networking, and cost ; build fair‑use and rate‑limiting controls.

What You Bring

  • Production Kubernetes and container internals (Docker/containerd); strong networking fundamentals.

  • Cloud (AWS/GCP/Azure) and IaC (Terraform/Helm).

  • Monitoring/Logging (Prometheus, Grafana, OpenTelemetry, ELK/Vector).

  • Security best practices for containerized, multi‑tenant systems.

Nice to Have

  • gVisor/Kata/Firecracker; Cilium/eBPF; GPU scheduling; serverless autoscaling (KEDA/Knative/Karpenter).

  • You’ve built an AI side project and enjoy tinkering with LLMs.

Why Julius

Small, senior team; massive impact surface; hard infra problems at meaningful scale.

Ready to apply to Julius AI?
Apply to Julius AI

How this Software Engineer salary compares

This role pays $175,000/yrbelow the typical range for Software Engineer roles.

$161,300 median $218,500 $362,500

Typical range $191,325–$264,500/yr, from 620 comparable Software Engineer listings on JobsRadar (pay annualized to USD). See Software Engineer salary insights →

Similar jobs

Redwood Materials
Embedded Software Engineer – Power Electronics, Energy Storage
Redwood Materials
⚡ Apply early San Francisco, California, Uni... Onsite $180,000–$237,500
● New 👁 Seen ✓ Applied 11h ago
Redwood Materials
Senior Software Engineer, Energy Storage
Redwood Materials
⚡ Apply early San Francisco, California, Uni... Onsite $150,000–$237,500
● New 👁 Seen ✓ Applied 12h ago
Redwood Materials
Software Engineer - Site Controller, Energy Storage
Redwood Materials
⚡ Apply early San Francisco, California, Uni... Onsite $180,000–$237,500
● New 👁 Seen ✓ Applied 14h ago
CoreWeave
Staff Software Engineer, Infrastructure - Marimo
CoreWeave
⚡ Apply early Livingston, NJ / New York, NY... · location restricted $188,000–$275,000
● New 👁 Seen ✓ Applied 15h ago
CoreWeave
Senior Software Engineer, SaaS Infrastructure - Weights & Biases
CoreWeave
⚡ Apply early Livingston, NJ / New York, NY... Onsite $153,000–$204,000
● New 👁 Seen ✓ Applied 15h ago
CoreWeave
Senior Software Engineer, molab
CoreWeave
⚡ Apply early New York, NY / San Francisco,... Onsite $165,000–$242,000
● New 👁 Seen ✓ Applied 15h ago
Lloyds Banking Group
Mobile Software Engineer - iOS
Lloyds Banking Group
⚡ Apply early London 1-10 Praed Mews Hybrid £76,760–£95,950
● New 👁 Seen ✓ Applied 4h ago
Lloyds Banking Group
Mobile Software Engineer - Android
Lloyds Banking Group
⚡ Apply early London 1-10 Praed Mews Hybrid £76,760–£95,950
● New 👁 Seen ✓ Applied 4h ago
Lloyds Banking Group
Backend Software Engineer
Lloyds Banking Group
⚡ Apply early London Hybrid £76,760–£95,950
● New 👁 Seen ✓ Applied 4h ago

Sign up for suggestions tailored to the jobs you open and the searches you save.

More jobs at Julius AI

See all jobs at Julius AI →

Apply now
🤖

Whoa — hold up

JobsRadar was built for real people having a rough time in their job search — not for automated requests. You're clicking way too fast and you're now temporarily blocked.

Come back later. If you're genuinely job hunting, we've got your back — just act like a human.

Catch your next role the second it’s posted.

Create a free account and we’ll watch the boards for you — the instant a job matches your search, it lands in your inbox or Telegram. No digging, no refreshing.

Create free account

Free forever · takes 30 seconds · already have one?

Get an edge on your job hunt.

Join our Telegram channel for the stuff that helps you land the role — salary benchmarks, the weekly market pulse, and new-feature drops. No spam, just signal.

Join the channel — it's free