Jobs › Companies › GoodData › Sr. Inference Engineer (LLM Serving)

Sobre este puesto de Sr. Inference Engineer (LLM Serving) en GoodData

GoodData · Presencial · Prague

Our platform turns governed business data into answers, reports and agents that companies put in front of their own customers. To make that AI trustworthy, private and affordable, we run it on our own inference: open-weight models on our own GPUs, so customer data never has to leave our boundary.

The role

You will own the serving layer of GoodData Native Inference. That means the models, the engine and the GPUs behind every AI answer our customers get. You will join the team that builds GoodData AI and become the person the whole company turns to for anything about running models in production.

What you will do

  • Deploy, operate and upgrade open-weight LLMs and smaller task models (guardrails, PII detection, classifiers, judges) on our GPUs, in production and across regions.

  • Make inference fast and cheap: tune batching, KV and prefix caching, quantization and parallelism, and track time to first token, tokens per second per GPU, p95 latency and cost per answer.

  • Choose the models: put new open-weight models through our evaluation harness on real analytics workloads, and recommend what goes to production.

  • Grow our inference gateway: routing by intent and complexity across models, a semantic cache, and validation that escalates weak answers.

  • Adapt models to our use cases with LoRA adapters and fine-tuning, such as generating queries for our semantic layer, root-cause analysis and narrative reports.

What you bring

  • 5+ years of software engineering, including 2+ years running ML or LLM models in production.

  • Hands-on production experience with at least one modern LLM serving engine: vLLM, SGLang or TensorRT-LLM.

  • A working understanding of inference bottlenecks (KV cache, attention, memory bandwidth, batching, parallelism), and the habit of reasoning about latency, throughput and cost in numbers.

  • Experience with Docker, Kubernetes and GPU instances in a public cloud.

  • Discipline in benchmarks and evaluation: you do not ship a model you have not measured.

  • Clear communication in English, with engineers and with product people.

Nice to have

  • Speculative decoding, multi-LoRA serving, or PEFT fine-tuning.

  • Contributions to vLLM, SGLang, PyTorch or similar open-source projects.

  • CUDA or Triton kernels, and the NVIDIA GPU stack (drivers, NCCL).

  • LLM routing, guardrail models, embeddings and rerankers.

  • Go or Rust; Terraform and Helm.

  • Observability for LLM systems (OpenTelemetry, Langfuse, Prometheus, Grafana).

  • Experience with analytics, semantic layers or text-to-SQL.

Our stack

Python, Kubernetes on AWS, NVIDIA GPUs, SIE (an open-source inference engine on SGLang), vLLM, PyTorch, gRPC, Langfuse, and our own evaluation harness.

About GoodData.AI

At GoodData.AI, we’re building the future of agentic AI for data intelligence.

Our full-stack data intelligence platform empowers companies to turn raw data into real business impact — from agentic AI apps to embedded analytics that scale securely and seamlessly. With GoodData.AI, organizations don’t just analyze data, they monetize it.

But what really sets GoodData.AI apart is our mission: to put intelligence wherever decisions are made. That’s why we’ve built a platform that’s AI-native, composable, and built for the way modern enterprises work.

 

#LI-Hybrid

¿Listo para postularte en GoodData?
Postúlate en GoodData

Empleos similares

GoodData
Sr. Solution & Product Analyst
GoodData
⚡ Postúlate pronto Prague Híbrido
● Nuevo 👁 Visto ✓ Postulado hace 1sem
GoodData
Sales Engineer
GoodData
⚡ Postúlate pronto San Francisco Híbrido $150,000–$170,000
● Nuevo 👁 Visto ✓ Postulado hace 2sem
GoodData
Enterprise Account Executive
GoodData
⚡ Postúlate pronto San Francisco Híbrido
● Nuevo 👁 Visto ✓ Postulado hace 2sem
GoodData
Sr. Backend Engineer (Kotlin)
GoodData
⚡ Postúlate pronto Prague Híbrido
● Nuevo 👁 Visto ✓ Postulado hace 4sem
GoodData
BI Solution Architect - Agentic Analytics
GoodData
⚡ Postúlate pronto Prague Presencial
● Nuevo 👁 Visto ✓ Postulado hace 4sem
GoodData
(Sr.) AI Python Developer
GoodData
⚡ Postúlate pronto Prague Híbrido
● Nuevo 👁 Visto ✓ Postulado hace 3 meses
GoodData
Sr. Software Engineer (Backend)
GoodData
⚡ Postúlate pronto Prague Híbrido
● Nuevo 👁 Visto ✓ Postulado hace 3 meses
RockawayX
Právník / Právnička / Compliance Specialist
RockawayX
⚡ Postúlate pronto Prague, Prague, Czechia Presencial
● Nuevo 👁 Visto ✓ Postulado hace 1h
ICON plc
Site Management Associate I
ICON plc
⚡ Postúlate pronto Romania, Bucharest Presencial
● Nuevo 👁 Visto ✓ Postulado hace 2h

Regístrate para recibir sugerencias adaptadas a los empleos que abres y las búsquedas que guardas.

Más empleos en GoodData

Ver todos los empleos en GoodData →

Postúlate ahora
🤖

Un momento — para

JobsRadar se creó para personas reales que están pasando un mal momento en su búsqueda de empleo — no para solicitudes automatizadas. Estás haciendo clic demasiado rápido y ahora estás bloqueado temporalmente.

Vuelve más tarde. Si de verdad estás buscando empleo, cuentas con nosotros — solo compórtate como una persona.

Catch your next role the second it’s posted.

Create a free account and we’ll watch the boards for you — the instant a job matches your search, it lands in your inbox or Telegram. No digging, no refreshing.

Create free account

Free forever · takes 30 seconds · already have one?

Toma ventaja en tu búsqueda de empleo.

Únete a nuestro canal de Telegram para lo que te ayuda a conseguir el puesto — referencias salariales, el pulso semanal del mercado y avisos de nuevas funciones. Sin spam, solo señal.

Únete al canal — es gratis