Jobs › Companies › Hello Heart › Clinical AI Quality Specialist

About this Clinical AI Quality Specialist role at Hello Heart

Hello Heart · Remote · Remote US

About Hello Heart:

Hello Heart is on a mission to make heart attacks a thing of the past.

We’re an AI company focused exclusively on heart health, building a platform that predicts and prevents cardiac events before they happen—identifying risk up to 10 days in advance versus 10 years in traditional clinical models. 

This is already working at scale. Hello Heart has been shown to reduce inpatient hospital days by 47% and deliver ~$1,800 in annual savings per member. Hello Heart is the cardiac prevention partner to over 80% of large U.S. health plans and serves hundreds of public and private employers.

We’re defining how the #1 cause of death—heart disease—is managed in the AI era. Join us.

About the role
Hello Heart’s AI team builds Nia, an AI health assistant for people managing their cardiovascular health. As a Clinical AI Quality Specialist, you will evaluate and monitor Nia’s clinical behavior before and after release, working alongside the Clinical AI Quality & Governance Team Lead. You will run evaluations, review production conversations, and turn findings into documented decisions with product and engineering. This is a hands-on role for a clinician who is comfortable working with AI tools.

Responsibilities

  • Run Nia’s offline evaluations for clinically relevant changes. Write test cases, including tricky and ambiguous ones, and score outputs against the expected clinical behavior. Build and maintain evaluation datasets and contribute to scoring methods 
  • Review production conversations using defined sampling methods. Take part in the weekly review and help prepare monthly results that state what was and wasn’t covered.
  • Test whether Nia detects and correctly handles high-risk situations, including medical emergencies, self-harm, and medication safety. Measure how often it escalates too much or too little.
  • Describe each failure clearly enough for engineering to act on, and flag your best read of the cause (for example, a wrong answer, missing patient context, or an escalation that fired too late). Make sure each unsafe or incorrect finding has an owner, a ticket, and a decision.
  • Keep clinical specifications, review records, and evidence current and auditable. Write clear, precise clinical assessments that engineering and product can act on.

Qualifications: 

  • PharmD (or equivalent clinical doctorate) with an active US license. 3+ years of combined clinical practice and clinical AI evaluation.
  • Questions assumptions and investigates before drawing conclusions. Reads current guidelines, drug labels, and primary sources, and cites them in written assessments. Uses AI tools to work faster, and verifies AI output against sources before relying on it.
  • Experience designing or running evaluations for LLM-based systems, reviewing production conversations, and using monitoring tools (e.g., Langfuse).
  • Command of triage and escalation, crisis and self-harm handling, and medication safety, grounded in current guidelines.
  • Comfortable working with AI tools and evaluation workflows.
  • Excellent written and verbal communication. Explains clinical risk clearly to engineering and product audiences, writes precise clinical assessments and documentation, and accepts feedback without defensiveness.
  • Genuine passion for how AI can improve preventive care and chronic disease management. Curious, open to learning, and comfortable with ambiguity and a fast-moving field.

Preferred Qualifications: 

  • Clinical experience in cardiovascular care or hypertension management.
  • Experience with structured rating of clinical transcripts, including agreement between raters.
  • Experience reviewing crisis and self-harm behavior.
  • Experience designing or running evaluations for LLM-based systems, or using monitoring tools such as Langfuse.

The United States base salary range for this full-time position is $130,000 to $143,000. Salary ranges are determined by role and level. Individual compensation is based on job-related skills, experience, and relevant education or training. Compensation details listed in United States job postings reflect annual salary and bonus only and do not include equity or benefits.

Hello Heart has a positive, diverse, and supportive culture - we look for people who are collaborative, creative, and courageous. Oh, and if you want to see some recent evidence of the fun things we do at Hello Heart, check out our Instagram page.  

Ready to apply to Hello Heart?
Apply to Hello Heart

Similar jobs

Hello Heart
Senior Talent Aquisition Partner
Hello Heart
⚡ Apply early Remote US · location restricted $110,000–$160,000
● New 👁 Seen ✓ Applied 10h ago
Hello Heart
Director, Global Supply Chain
Hello Heart
⚡ Apply early Remote US · location restricted $155,000–$170,000
● New 👁 Seen ✓ Applied 10h ago
Hello Heart
Senior Director, Product Growth
Hello Heart
⚡ Apply early Tel Aviv, Israel Onsite
● New 👁 Seen ✓ Applied 10h ago
Hello Heart
Vice President, Large Employer Sales
Hello Heart
⚡ Apply early Remote US · location restricted $155,000–$175,000
● New 👁 Seen ✓ Applied 10h ago
Hello Heart
Senior Director, Actuarial Services
Hello Heart
⚡ Apply early Remote US · location restricted $235,000–$270,000
● New 👁 Seen ✓ Applied 10h ago
Hello Heart
Director, Actuarial Services
Hello Heart
⚡ Apply early Remote US · location restricted $200,000–$225,000
● New 👁 Seen ✓ Applied 10h ago
Hello Heart
Director, Key Account Sales
Hello Heart
⚡ Apply early Remote US · location restricted $110,000–$130,000
● New 👁 Seen ✓ Applied 10h ago
Hello Heart
Entrepreneur in Residence
Hello Heart
⚡ Apply early Remote US · location restricted $240,000–$260,000
● New 👁 Seen ✓ Applied 10h ago
Hello Heart
Vice President, Health Plan Sales
Hello Heart
⚡ Apply early Remote US · location restricted $160,000–$200,000
● New 👁 Seen ✓ Applied 10h ago

Sign up for suggestions tailored to the jobs you open and the searches you save.

More jobs at Hello Heart

See all jobs at Hello Heart →

Apply now
🤖

Whoa — hold up

JobsRadar was built for real people having a rough time in their job search — not for automated requests. You're clicking way too fast and you're now temporarily blocked.

Come back later. If you're genuinely job hunting, we've got your back — just act like a human.

Catch your next role the second it’s posted.

Create a free account and we’ll watch the boards for you — the instant a job matches your search, it lands in your inbox or Telegram. No digging, no refreshing.

Create free account

Free forever · takes 30 seconds · already have one?

Get an edge on your job hunt.

Join our Telegram channel for the stuff that helps you land the role — salary benchmarks, the weekly market pulse, and new-feature drops. No spam, just signal.

Join the channel — it's free