We are launching a strategic pool of AI specialists to accelerate the growth of our AI Practice and turn strong market demand into scalable, repeatable capabilities. This role goes beyond project delivery-it is about shaping how AI is built, shared, and scaled across the company.

As part of this group, you will play a key role in internal capability development, with a strong focus on designing and evolving AI Accelerators-reusable frameworks, templates, and reference architectures covering GenAI, LLM-based solutions, ML pipelines, and cloud-native AI systems. These accelerators will become the backbone of our AI offerings, enabling faster delivery, higher quality, and consistent technical standards across projects.

A second core dimension of the role is knowledge leadership. Strategic hires will actively contribute to internal knowledge-sharing initiatives: technical deep dives, hands-on workshops, demos, and best-practice sessions covering topics such as GenAI orchestration, RAG, model deployment, prompt and system design, observability, and cost-efficient AI architectures. You will help raise the overall AI maturity of the organization while mentoring engineers and influencing technical direction. In addition, members of this group will act as AI project jumpstarters, joining new client engagements for up to 50% allocation over 1-2 months. In this capacity, you will help define solution architectures, validate technical approaches, build initial prototypes, and set strong engineering foundations before teams scale. This gives you exposure to diverse domains and cutting-edge AI use cases while maximizing your impact across multiple initiatives.

Project Description

We are looking for a highly skilled and innovative Machine Learning Engineer to develop and expand our Generative AI and Computer Vision capabilities. This role involves accelerating Technical Sales Support, Architecture and PoC development.

Technologies

• Python
• Git, CI/CD practices for ML and data pipelines
• AWS and/or Azure
• PyTorch, TensorFlow
• MLflow
• LLMs and NLP tasks
• Generative AI concepts
• LangChain/LangGraph, LlamaIndex
• Qdrant, Pinecone, Weaviate, FAISS or similar
• RNNs, Transformers
• Dataset labeling, annotation tools (e.g., Label Studio, CVAT)
• Prometheus, Grafana, DataDog, OpenTelemetry
• YOLO, SDD
• Segmentation models
• Image Classification

What You'll Do

• Lead the design, development, and deployment of scalable ML services;
• Architect and implement AI/ML solutions, ensuring model quality, governance, and security;
• Optimize ML workflows for performance and cost efficiency on cloud platforms (AWS, Azure, or GCP);
• Collaborate with data scientists, analysts, and business stakeholders to understand ML requirements;
• Mentor and guide junior engineers, promoting best practices in ML engineering;
• Develop and maintain documentation, ML models, and technical standards;
• Monitor, troubleshoot, and resolve issues in production for ML pipelines and environments;
• Stay up-to-date with emerging trends and technologies in AI/ML field;

Job Requirements

• Bachelor’s or Master’s degree in Computer Science, Engineering, Mathematics, or a related field;
• 5+ years of experience in ML engineering, with at least 1 years of hands-on experience with LLMs;
• Strong proficiency in Python;
• Experience with cloud data platforms (AWS and/or Azure);
• Familiarity with CI/CD, DevOps, and infrastructure-as-code practices for ML engineering;
• Experience with data governance, security, and compliance in cloud environments;
• Excellent problem-solving, communication, and leadership skills;
• English: Upper Intermediate level or higher;

What Do We Offer

The global benefits package includes:

• Technical and non-technical training for professional and personal growth;
• Internal conferences and meetups to learn from industry experts;
• Support and mentorship from an experienced employee to help you professional grow and development;
• Health insurance;
• English courses;
• Sports activities to promote a healthy lifestyle;
• Flexible work options, including remote and hybrid opportunities;
• Referral program for bringing in new talent;
• Work anniversary program and additional vacation days.

Why Kimchi?

Kimchi is the AI platform inside CAST AI. We started by helping companies run LLMs on their own Kubernetes clusters - now we're building the execution layer where agents do real work.

Our Infrastructure today: multi-model inference (MiniMax, Kimi, GLM-5, Nemotron, DeepSeek) with intelligent routing, an OpenAI-compatible API, and deployment flexibility from our GPUs to your VPC. The inference layer is the foundation. What we're hiring for sits on top of it: coding agents, agent runtimes, orchestration systems, and the reliability engineering that makes them actually finish things.

Tech Stack: TypeScript, Go, Kubernetes, AWS/GCP/Azure, MCP, Prometheus/Grafana/Loki, GitLab CI, ArgoCD.

Why harness engineering matters here
OpenAI and Anthropic ship models. They also ship one harness each - the scaffolding that turns a raw model into something that can plan, execute, recover, and complete work. We ship a different kind of harness: one built for cost-conscious, long-horizon autonomy, running on inference infrastructure we control end-to-end.
A decent model with a great harness beats a great model with a bad harness. We've watched this play out. The gap between what today's models can do and what you see them doing is largely a harness gap - and that gap is where we operate.

What you'll build
The ratchet.
Every time our agent makes a mistake, we engineer a solution so it never makes that mistake again. That means hooks that enforce constraints the model "knows" but forgets: pre-commit lint checks, permission gates, context compaction before the window fills. Success is silent, failures are verbose.

Long-horizon execution.
Our harness is built around spec-driven autonomy: meta-prompting, fresh context per task, worktree-per-slice git strategy, automatic replanning, crash recovery, stuck detection. We're implementing Ralph loops - when the model tries to exit, we intercept and reinject the goal into a fresh context. The agent reads state from disk and continues. Multi-session, multi-day work, without context rot.

Planner/executor splits.
Planning with a reasoning model, executing with a fast one, evaluating with a third. Separating generation from evaluation beats self-verification because agents reliably skew positive when grading their own work.

The harness surface.
CLI, TUI, MCP integration, sandboxed execution, telemetry. Our AGENTS.md is short - every line traces to a specific thing that went wrong. TypeScript on the surface, Go where it matters.

Memory and context.
Moving agents off laptops, giving them state that survives across sessions, managing context so information lands where it's actionable. Compaction, tool-call offloading, progressive skill disclosure.

What makes this different (with receipts)
You've seen the pitch: "we route to the best model." Everyone says that. Here's what we actually have:

• GPU infrastructure we own. Not just an API reseller. From GPU placement across clouds to the inference endpoint your agent calls - we control the cost curve.
• A harness-first thesis. We treat agent failures as configuration problems, not model problems. When we moved from a stock harness to our own, completion rates on internal benchmarks improved by 40%+ on the same model.
• Agents.md that earns every line. No brainstormed rules - every constraint in our system prompt traces to a real failure we saw and fixed.

Requirements:

• You've used AI coding agents in anger. Not demos - real work. You have opinions about Claude Code, Codex, OpenCode, Cursor. You know what it feels like when an agent gets stuck and why.
• Strong TypeScript or Go in production. Comfort moving between them. Our surface is TypeScript; our core is Go.
• You think in harness terms. You read "the agent hallucinated" and your first instinct is to ask what context it was missing, what hook should have caught it, what constraint should exist.
• You drive features end-to-end. Design → build → ship → measure → iterate. We don't have layers that absorb ambiguity for you.

Responsibilities:

• Build and evolve the agent harness - ship hooks, permission gates, and context compaction. Every AGENTS.md constraint traces to a failure you personally diagnosed.
• Own long-horizon execution - multi-session task completion via spec-driven prompting, worktree-per-slice git, Ralph loop recovery, and stuck detection. Completion rate is your metric.
• Architect planner/executor/evaluator pipelines - planning with a reasoning model, execution with a fast one, evaluation with a third. No self-verification.
• Manage agent memory and context - state persistence across sessions, context compaction, tool-call offloading. Zero context rot on multi-day work.
• Own the harness surface - CLI, TUI, MCP integrations, sandboxed execution, telemetry. TypeScript on the surface, Go where it matters.

What success looks like (after 6 months):

• You've shipped at least one major harness feature end-to-end: designed it, built it, measured it, iterated.
• You've added constraints to our AGENTS.md based on failures you personally observed and diagnosed.
• You've improved a measurable reliability metric - completion rate, context efficiency, or cost per successful task.
• You've formed strong opinions about where our harness is load-bearing and where it's dead weight.

What’s in it for you?

• Competitive salary (€6,500 - €9,000 gross, depending on the level of experience).
• Enjoy a flexible, remote-first global environment.
• Collaborate with a global team of cloud experts and innovators, passionate about pushing the boundaries of Kubernetes technology
• Equity options.
• Get quick feedback with a fast-paced workflow. Most feature projects are completed in 1 to 4 weeks.
• Spend 10% of your work time on personal projects or self-improvement. 
• Learning budget for professional and personal development - including access to international conferences and courses that elevate your skills.
• Annual hackathon to spark new ideas and strengthen team bonds.
• Team-building budget and company events to connect with your colleagues.
• Equipment budget to ensure you have everything you need.
• Extra days off to help maintain a healthy work-life balance.

This is a location-specific opportunity. We are currently accepting applications from candidates residing in the following European countries: Bulgaria, Croatia, Estonia, Greece, Hungary, Latvia, Lithuania, Poland, Romania, Slovakia, Slovenia, and Ukraine.

*As part of our standard hiring process, we would like to inform you that a background check may be conducted at the final stage of recruitment through our third-party provider, Checkr.
*Please note that Cast AI does not provide any form of visa sponsorship/work permit.

#LI-Remote