Jobs Companies LILT Quality Manager, Applied AI

Sobre este puesto de Quality Manager, Applied AI en LILT

LILT · Híbrido · Boston, MA

About LILT

AI is changing how the world communicates — and LILT is leading that transformation.

We're on a mission to make the world's information accessible to everyone, regardless of the language they speak. We use cutting-edge AI, machine translation, and human-in-the-loop expertise to translate content faster, more accurately, and more cost-effectively without compromising on brand, voice, or quality.

At LILT, we empower our teammates with leading tools, global collaboration, and growth opportunities to do their best work. Our company virtues—Work together, win together; Find a way or make one; Dance in the customer's shoes; Quicker than they expect; Quality is Job 1—guide everything we do. We are trusted by Intel Corporation, Canva, the United States Department of Defense, the United States Air Force, ASICS, and hundreds of global Enterprises. Backed by Sequoia, Intel Capital, and Redpoint, we’re building a category-defining company in a $50B+ global translation market being redefined by AI.

Key Responsibilities

  • Ensure Workflows Are Built for Quality

    • Outcome: Every Applied AI deliverable ships with measured quality: rater agreement meets agreed thresholds per dimension, rubric scores are reproducible across raters, and reported quality figures hold up under customer audit.

  • Own Technical Tooling & Quality Infrastructure

    • Outcome: Quality metrics for every active program (defect rate, acceptance rate, rework, reviewer reliability, throughput, SLA adherence) are available without manual compilation, and systemic quality issues are detected from workflow data before a customer reports them.

  • Own Operational Quality at Scale

    • Outcome: Concurrent programs meet their quality targets within agreed cost and throughput. Acceptance rates hold at or above target, rework declines over time, and standard QC on standardized workflows is executed and interpreted by Production staff without Quality Manager involvement by the end of the second quarter in role.

  • Delivery sign-off: Every deliverable has a documented go/no-go decision before shipping, based on programmatic QA and a readiness memo with flags. Post-sign-off quality escapes stay below an agreed threshold, and each escape results in a documented process change.

  • Own Customer Quality Remediation

    • Outcome: Customer quality disputes are closed with quantitative analysis, normally at first response. Re-adjudication completes within SLA, recurring defect classes decline release over release, and annotator integrity issues are detected internally before they reach a deliverable.

Qualifications

  • Education: B.S./M.S. in a quantitative field (CS, Statistics, Data Science, Engineering, Linguistics, HCI) or equivalent practical experience.

  • Applied AI / evaluation experience: 6+ years building or operating quality programs for ML/LLM systems (data labeling, benchmark creation, model evaluation, or human-in-the-loop pipelines).

  • Quality systems leadership: Proven ability to design and run end-to-end quality frameworks (rubrics, sampling plans, QC gates, acceptance criteria, escalation paths) across multiple concurrent programs.

  • Measurement & statistics: Strong grasp of reliability and agreement methods (e.g., Krippendorff’s α, Cohen’s κ), power/sample-size intuition, error analysis, and reporting for executive stakeholders.

  • Rater/annotator operations: Experience with calibration, adjudication, targeted retraining, drift monitoring, and integrity/fraud detection in high-throughput human evaluation programs.

  • Tooling & automation: Hands-on with labeling/eval tooling (e.g., Label Studio or similar) and designing deterministic validations; comfort partnering with engineering/research to implement quality instrumentation.

  • Data governance: Strong understanding of dataset/version management, traceability, privacy/compliance constraints, and audit-ready documentation for deliverables.

  • Stakeholder management: Excellent written and verbal communication; able to translate ambiguous research goals into measurable quality targets and negotiate tradeoffs with Applied AI, product, and external partners.

Preferred Skills

  • Fluency in multiple human languages.

  • Proficiency in a programming language and experience working with modern AI frameworks.

Our Story

Our founders, Spence and John met at Google working on Google Translate. As researchers at Stanford and Berkeley, they both worked on language technology to make information accessible to everyone. While together at Google, they were amazed to learn that Google Translate wasn’t used for enterprise products and services inside the company.The quality just wasn’t there. So they set out to build something better. LILT was born.

LILT has been a machine learning company since its founding in 2015. At the time, machine translation didn’t meet the quality standard for enterprise translations, so LILT assembled a cutting-edge research team tasked with closing that gap. While meeting customer demand for translation services, LILT has prioritized investments in Large Language Models, human-in-the-loop systems, and now agentic AI.

With AI innovation accelerating and enterprise demand growing, the next phase of LILT’s journey is just beginning.

Our Tech

What sets our platform apart:

  • Brand-aware AI that learns your voice, tone, and terminology to ensure every translation is accurate and consistent

  • Agentic AI workflows that automate the entire translation process from content ingestion to quality review to publishing

  • 100+ native integrations with systems like Adobe Experience Manager, Webflow, Salesforce, GitHub, and Google Drive to simplify content translation

  • Human-in-the-loop reviews via our global network of professional linguists, for high-impact content that requires expert review


LILT in the News

Information collected and processed as part of your application process, including any job applications you choose to submit, is subject to LILT's Privacy Policy at https://lilt.com/legal/privacy.

At LILT, we are committed to a fair, inclusive, and transparent hiring process. As part of our recruitment efforts, we may use artificial intelligence (AI) and automated tools to assist in the evaluation of applications, including résumé screening, assessment scoring, and interview analysis. These tools are designed to support human decision-making and help us identify qualified candidates efficiently and objectively. All final hiring decisions are made by people. If you have any concerns, require accommodations, or would like to opt-out of the use of AI in our hiring process, please let us know at [email protected].

LILT is an equal opportunity employer. We extend equal opportunity to all individuals without regard to an individual’s race, religion, color, national origin, ancestry, sex, sexual orientation, gender identity, age, physical or mental disability, medical condition, genetic characteristics, veteran or marital status, pregnancy, or any other classification protected by applicable local, state or federal laws. We are committed to the principles of fair employment and the elimination of all discriminatory practices.

¿Listo para postularte en LILT?
Postúlate en LILT

Empleos similares

Regístrate para recibir sugerencias adaptadas a los empleos que abres y las búsquedas que guardas.

Más empleos en LILT

Ver todos los empleos en LILT →

Postúlate ahora
🤖

Un momento — para

JobsRadar se creó para personas reales que están pasando un mal momento en su búsqueda de empleo — no para solicitudes automatizadas. Estás haciendo clic demasiado rápido y ahora estás bloqueado temporalmente.

Vuelve más tarde. Si de verdad estás buscando empleo, cuentas con nosotros — solo compórtate como una persona.

Catch your next role the second it’s posted.

Create a free account and we’ll watch the boards for you — the instant a job matches your search, it lands in your inbox or Telegram. No digging, no refreshing.

Create free account

Free forever · takes 30 seconds · already have one?

Toma ventaja en tu búsqueda de empleo.

Únete a nuestro canal de Telegram para lo que te ayuda a conseguir el puesto — referencias salariales, el pulso semanal del mercado y avisos de nuevas funciones. Sin spam, solo señal.

Únete al canal — es gratis