Jobs › Companies › Avra › Member of Technical Staff | Inference Platform

Über diese Member of Technical Staff | Inference Platform Stelle bei Avra

Avra · Remote · São Paulo

About Avra

Avra is a frontier AI lab building relational foundation models from the ground up (no third-party wrappers).

We model how businesses and individuals are connected and interact over time. Put simply: we bring connections into the math.

Leading enterprises in LatAm use Avra's models to power key decisions in credit, growth, and fraud. Our customers include the largest banks and marketplaces in Latin America, such as Mercado Libre, Telefonica, Banco Inter and Getnet.

Avra was founded in 2024 by Viviane Meister and Bruno Alano (ex-OpenAI). Our investors include NXTP, Clocktower Ventures, as well as the Sequoia and a16z scouts. We are accelerated by NVIDIA, AWS, and Google.

We are a team of builders. Join us.

About the role

At Avra, every technical IC is a Member of Technical Staff (MTS). The title doesn't put anyone in a silo: you own systems and outcomes, not steps in a function, and you keep building depth in your area.

In this role, you'll join the Platform team to own where our models execute. Customers consume our models through large batches of millions of records and through real-time APIs, and they make business decisions on every response. You'll run governed model releases reliably and efficiently — in our cloud and on customer-hosted Kubernetes — and make inference fast, predictable, and cheap enough to serve both enterprise and mid-market customers.

What you'll do

  • Evolve Sophos, our online and batch inference runtime, built on Kubernetes.

  • Run large batch inference on ephemeral jobs, with multi-dimensional admission control (CPU, memory, GPU).

  • Build and extend the controller and its Kubernetes custom resources.

  • Optimize each model's inference engine and feature processing.

  • Serve graphs and data efficiently.

  • Own execution of training, post-training, and fine-tuning jobs, in our cloud and in customer dataplanes / on-premisse cloud.

  • Drive autoscaling, GPU serving, performance, and cost optimization, with telemetry for every model we run.

How we measure success

  • 99.9% serving availability.

  • p95/p99 latency for online inference and throughput for batch.

  • Cost per prediction and per training job.

  • GPU utilization: paid capacity versus capacity actually used.

  • Training and batch jobs that finish on time and succeed without manual retries.

What we're looking for

  • 7+ years of relevant engineering experience at tech and product-driven companies

  • Experience running model serving or large-scale batch compute on Kubernetes.

  • Experience building Kubernetes controllers or operators.

  • Skill at profiling and optimizing data-heavy Python pipelines.

  • A clear sense of cost: you treat compute efficiency as a product feature.

  • Production-quality code and reviews, and a willingness to operate what you build.

Nice to have

  • Ray, Ray Serve, or KubeRay in production.

  • Admission-control systems.

  • GPU serving and performance optimization.

  • Arrow, Parquet, Lance, or other columnar formats.

  • Shipping software to customer-hosted Kubernetes.

  • GCP/AWS and GKE/EKS, and financial services or regulated environments.

Bereit, sich bei Avra zu bewerben?
Bei Avra bewerben

Ähnliche Jobs

Avra
Member of Technical Staff | Knowledge Platform
Avra
⚡ Früh bewerben São Paulo · standortgebunden
● Neu 👁 Gesehen ✓ Beworben vor 2 Tg.
Avra
Member of Technical Staff | Product Platform
Avra
⚡ Früh bewerben São Paulo · standortgebunden
● Neu 👁 Gesehen ✓ Beworben vor 1 Wo.
Avra
Member of Technical Staff | Deployment Platform
Avra
⚡ Früh bewerben São Paulo · standortgebunden
● Neu 👁 Gesehen ✓ Beworben vor 1 Wo.
Avra
Deployment Strategist
Avra
⚡ Früh bewerben São Paulo Hybrid
● Neu 👁 Gesehen ✓ Beworben vor 2 Wo.
Avra
Open Application
Avra
⚡ Früh bewerben São Paulo · standortgebunden
● Neu 👁 Gesehen ✓ Beworben vor 3 Wo.
Avra
Member of Technical Staff, Research — Relational Foundation Models
Avra
⚡ Früh bewerben Remote · standortgebunden
● Neu 👁 Gesehen ✓ Beworben vor 3 Wo.
Avra
GTM Enterprise - Founding Team
Avra
⚡ Früh bewerben São Paulo Hybrid
● Neu 👁 Gesehen ✓ Beworben vor 3 Wo.
Avra
Head of Research
Avra
⚡ Früh bewerben Remote · standortgebunden
● Neu 👁 Gesehen ✓ Beworben vor 3 Wo.
Rws
Brazilian Portuguese - Religion & Philosophy Subject Matter Expert (SME)
Rws
⚡ Früh bewerben São Paulo · standortgebunden
● Neu 👁 Gesehen ✓ Beworben vor 2 Std.

Registrieren für Vorschläge, die auf die von Ihnen geöffneten Jobs und gespeicherten Suchen zugeschnitten sind.

Mehr Jobs bei Avra

Alle Jobs bei Avra ansehen →

Jetzt bewerben
🤖

Moment — langsam

JobsRadar wurde für echte Menschen gebaut, die eine schwere Zeit bei der Jobsuche haben — nicht für automatisierte Anfragen. Sie klicken viel zu schnell und sind jetzt vorübergehend blockiert.

Kommen Sie später wieder. Wenn Sie wirklich auf Jobsuche sind, stehen wir hinter Ihnen — verhalten Sie sich einfach wie ein Mensch.

Catch your next role the second it’s posted.

Create a free account and we’ll watch the boards for you — the instant a job matches your search, it lands in your inbox or Telegram. No digging, no refreshing.

Create free account

Free forever · takes 30 seconds · already have one?

Verschaffe dir einen Vorsprung bei der Jobsuche.

Tritt unserem Telegram-Kanal bei für das, was dir hilft, die Stelle zu bekommen — Gehaltsbenchmarks, den wöchentlichen Marktpuls und neue Feature-Drops. Kein Spam, nur Signal.

Dem Kanal beitreten — kostenlos