About Salvo Software

Salvo Software is a global technology company specializing in custom software development and advanced engineering solutions. With distributed teams across the US, LATAM, and India, we partner with clients to build high-performance, scalable systems that solve complex technical challenges. Our culture values innovation, ownership, and engineering excellence. We're growing our AI department and are looking for a hands-on AI Developer to help build it.

Role Overview

We are looking for an AI Developer to join and strengthen our AI department. Your core work will be building and operating LLM-powered systems: serving open-source models with Ollama and llama.cpp, building RAG pipelines, and developing MCP integrations that connect large languange models to real tools and data. Solid DevOps fundamentals - Docker, CI/CD, Azure - support this work, but AI engineering is the heart of the role.

You don't need to be a deep ML researcher. What matters is production-grade Python, strong fundamentals, and the aptitude to learn fast. You'll work closely with our engineering and product teams to take LLM-powered features from prototype to reliably deployed systems, with mentorship available as you ramp up in areas like RAG architecture, Kafka, and advanced MCP work.

Key Responsibilities

AI / LLM Engineering (core focus)

• Serve and operate open-source LLMs using Ollama and llama.cpp, locally and in on-prem environments.
• Build and maintain RAG pipelines: embeddings, vector databases, chunking strategies, and retrieval quality.
• Develop MCP (Model Context Protocol) integrations connecting LLMs to internal tools and data sources.
• Build backend services in Python that power ML inference and AI-driven product features.
• Parse and process structured and semi-structured data (XML/XSD, Office document formats) as pipeline inputs.
• Grow into model optimization over time: quantization (GGUF), GPU/CUDA tuning, and offline/air-gapped deployments.

DevOps & Infrastructure (supporting)

• Build and maintain CI/CD pipelines for AI services (Azure DevOps preferred; GitHub Actions / GitLab CI also used).
• Deploy AI workloads to Microsoft Azure,AWS and containerize services with Docker.
• Automate operational tasks with Python, Bash and/or PowerShell scripting.
• Troubleshoot across the stack - dig into root causes rather than patching symptoms.
• Support event-driven architectures using Apache Kafka (producers/consumers).

Requirements

Required

• Production-level Python - real services and pipelines, not just scripts.
• Hands-on experience serving LLMs with Ollama and/or llama.cpp.
• 3–5 years of hands-on experience across backend, ML engineering, DevOps, or infrastructure.
• Working knowledge of Docker and Linux fundamentals.
• Experience with Microsoft Azure, AWS and cloud-based deployments.
• Practical experience building and maintaining CI/CD pipelines (Azure DevOps strongly preferred; GitHub Actions / GitLab CI also relevant).
• Comfortable scripting in Python, Bash and/or PowerShell.
• Strong Git fundamentals and branching/workflow discipline.
• A troubleshooting mindset - able to work through ambiguity and dig into root causes.
• Fast learner with genuine aptitude and willingness to pick up new tools quickly.
• Good communication and collaboration skills; comfortable in a remote, distributed team.
• GPU/CUDA troubleshooting experience.

Should Have (can ramp up with mentorship)

• RAG concepts: vector databases, embeddings, chunking strategies.
• Advanced MCP (Model Context Protocol) knowledge.
• Kubernetes (kubectl basics).
• Infrastructure as code with Terraform.
• Apache Kafka fundamentals (producer/consumer patterns).

Nice to Have

• A systems language: Go, Rust, C++, or Zig.
• llama.cpp at a deeper level - building and quantizing models.
• Observability tooling (Prometheus/Grafana) and SRE practices.
• Exposure to security and compliance frameworks (SOC 2, ISO 27001, Zero Trust).
• Familiarity with DevSecOps practices and secure pipeline design.
• Experience deploying Kotlin (or other JVM-based) applications.
• Linux and Windows systems administration background.

Soft Skills

• Can explain why something broke, not just that it did.
• Comfortable saying "I don't know - I'll find out."
• Self-directed learner (side projects, home lab, open-source contributions).
• Takes feedback well and asks good questions.
• Strong ownership and problem-solving ability across time zones.