Jobs › Companies › Nextech › Lead Software Engineer in Test – Agentic AI (Remote - US)

À propos de ce poste Lead Software Engineer in Test – Agentic AI (Remote - US) chez Nextech

Nextech · Télétravail · Remote
Why join Nextech?
 
We are a leader in specialty healthcare technology solutions.
 
We’re committed to hiring and retaining talent, which is why we invest in our employees through competitive pay, a generous bonus structure, great healthcare, a comprehensive wellness program, and many other benefits.
 
If you are a software engineer, finance or accounting professional, customer support specialist, or a business development expert with a passion for healthcare technology (just to name a few), we want to hear from you.
 
We are an equal opportunity employer with a commitment to diversity.  All individuals, regardless of personal characteristics are encouraged to apply. If you are a candidate in need of assistance or an accommodation in the application process, please contact [email protected].

Essential Functions

  • In addition to adhering to Nextech’s conduct and behavioral standards, responsibilities include:

  • Design, develop, and maintain scalable automation frameworks and regression test suites across UI, API, backend, and AI-driven applications.
  • Lead quality engineering initiatives for Agentic AI systems, including LLM workflows, RAG pipelines, autonomous agents, and distributed orchestration platforms.
  • Validate complex AI agent behaviors such as multi-agent coordination, tool calling, prompt chaining, memory retention, conversational workflows, and fallback/retry mechanisms.
  • Develop and execute functional, integration, regression, end-to-end, and performance testing strategies across cloud-native and distributed environments.
  • Collaborate with Software Engineers, Product Managers, and DevOps teams to integrate testing throughout the software development lifecycle.
  • Build reusable automation solutions to validate APIs, orchestration layers, asynchronous workflows, enterprise integrations, and AI-driven business processes.
  • Design and maintain robust test environments, CI/CD integrations, cloud execution platforms, and automation pipelines to improve efficiency and reliability.
  • Establish and drive best practices related to code quality, maintainability, scalability, dependency injection, observability, and testability.
  • Lead validation efforts for AI workflow resiliency, distributed system reliability, data consistency, and orchestration performance under failure and edge-case conditions.
  • Mentor QA engineers and contribute to the development of scalable QA standards, automation strategies, reporting practices, and continuous improvement initiatives.
  • Minimum Requirements

  • Bachelor’s degree in Computer Science, MIS, Engineering, or a related technical field.
  • 8+ years of experience in Software Development or Software Engineer in Test (SDET/SET) roles.5+ years of hands-on experience developing automation frameworks using JavaScript/TypeScript or Java.
  • Strong experience with automation tools such as Playwright, Cypress, Postman, K6, or equivalent frameworks.2+ years of experience testing AI-powered applications, LLM systems, Agentic AI platforms, orchestration frameworks, or autonomous workflows.
  • Hands-on experience validating agent orchestration workflows, conversational AI applications, multi-step reasoning systems, and AI-driven business processes.
  • Experience testing AI orchestration frameworks such as LangGraph, CrewAI, AutoGen, Semantic Kernel, or similar technologies.
  • Strong expertise in API testing, backend integration testing, UI automation, and end-to-end workflow validation.
  • Solid understanding of automation architecture, design patterns, anti-patterns, dependency injection, and inversion of control principles.
  • Experience working in cloud-native and containerized environments (Azure, AWS, GCP, Docker, Kubernetes).Proven experience integrating automated test suites into CI/CD pipelines and distributed cloud environments.
  • Experience validating asynchronous, event-driven, and distributed systems with a focus on resiliency and fault tolerance.
  • Strong analytical, debugging, troubleshooting, and problem-solving skills.
  • Excellent organizational, communication, and stakeholder collaboration skills in Agile environments.
  • Experience with AI observability, telemetry, RAG pipeline validation, vector databases, or prompt evaluation frameworks (preferred).
  • Preferred Qualifications

  • Experience with Azure DevOps, GitHub Actions, or similar CI/CD platforms.
  • Experience with AI observability tools, telemetry platforms, and prompt evaluation frameworks.Experience validating RAG pipelines, vector databases, and AI response accuracy.
  • Knowledge of healthcare systems, HIPAA compliance, and regulated enterprise environments.
  • Experience with event-driven architectures, messaging systems, and distributed data platforms (including SQL Server).
  • Prior experience leading QA teams, mentoring engineers, and implementing enterprise test reporting and quality metrics practices.
  • Work Environment/Physical Demands

  • Remote work
  • Activities require a significant amount of work in front of a computer monitor.

  • Total Rewards: 
    Generous annual bonus opportunity
    401(k) with Employer Match
    Flexible Time Off: take time off when you need it without worrying about available hours
    11 paid holidays 
    Your Day Your Way - Celebrate a day of cultural or social significance to you
    Access to Linkedin Learning courses for professional development
    Insurance: Choice of Medical, Dental, and Vision plans
    Health Savings Account with employer match
    Flexible Spending Account
    100% Company-Paid Parental leave (After 6 months with the company)
    Company-Paid Life Insurance and Short/Long Term Disability Insurance
    Nextech Luminary Peer Recognition Program
    Employee Assistance Program with free counseling sessions available
    Corporate Discounts on Retail, Travel, and Entertainment
     
    Prêt à postuler chez Nextech ?
    Postuler chez Nextech

    Emplois similaires

    Stitch Fix
    Lead Engineer - Product Catalog Team
    Stitch Fix
    ⚡ Postuler tôt Remote, USA · lieu restreint $125,000–$186,000
    ● Nouveau 👁 Vu ✓ Postulé il y a 7 h
    FeverUp
    Lead AI Engineer
    FeverUp
    ⚡ Postuler tôt Remote Spain · lieu restreint
    ● Nouveau 👁 Vu ✓ Postulé il y a 7 h
    FeverUp
    Tech Lead
    FeverUp
    ⚡ Postuler tôt Remote Brazil · lieu restreint
    ● Nouveau 👁 Vu ✓ Postulé il y a 7 h
    Black Duck Software, Inc.
    Lead Partner Sales Engineer
    Black Duck Software, Inc.
    ⚡ Postuler tôt France Sur site
    ● Nouveau 👁 Vu ✓ Postulé il y a 7 h
    GDIT
    AWS Technical Lead/Sr. Java/Angular Developer (US Citizenship Required)
    GDIT
    ⚡ Postuler tôt Any Location / Remote · lieu restreint $131,750–$178,250
    ● Nouveau 👁 Vu ✓ Postulé il y a 9 h
    Diagrid
    Senior Software Engineer (Dapr OSS) – India Lead
    Diagrid
    ⚡ Postuler tôt Remote India · lieu restreint
    ● Nouveau 👁 Vu ✓ Postulé il y a 14 h
    Cscgeneration
    Lead Software Engineer, E-Commerce Platform
    Cscgeneration
    ⚡ Postuler tôt Remote - Canada · lieu restreint
    ● Nouveau 👁 Vu ✓ Postulé il y a 14 h
    Reddit
    Lead Forward Deployed Engineer (AI Enablement)
    Reddit
    ⚡ Postuler tôt Remote - United States · lieu restreint $194,600–$272,400
    ● Nouveau 👁 Vu ✓ Postulé il y a 17 h
    Stellic
    Tech Lead, Progress
    Stellic
    ⚡ Postuler tôt This role is hybrid/in-office... Hybride $210,000–$260,000
    ● Nouveau 👁 Vu ✓ Postulé il y a 21 h

    Inscrivez-vous pour des suggestions adaptées aux emplois que vous ouvrez et aux recherches que vous enregistrez.

    Plus d’emplois chez Nextech

    Voir tous les emplois chez Nextech →

    Postuler maintenant
    🤖

    Doucement — un instant

    JobsRadar a été conçu pour de vraies personnes qui traversent une période difficile dans leur recherche d’emploi — pas pour des requêtes automatisées. Vous cliquez beaucoup trop vite et vous êtes maintenant temporairement bloqué.

    Revenez plus tard. Si vous cherchez réellement un emploi, nous sommes de votre côté — agissez simplement comme un être humain.

    Catch your next role the second it’s posted.

    Create a free account and we’ll watch the boards for you — the instant a job matches your search, it lands in your inbox or Telegram. No digging, no refreshing.

    Create free account

    Free forever · takes 30 seconds · already have one?

    Prenez une longueur d’avance dans votre recherche d’emploi.

    Rejoignez notre canal Telegram pour ce qui vous aide à décrocher le poste — références salariales, le pouls hebdomadaire du marché et les annonces de nouveautés. Pas de spam, que du signal.

    Rejoindre le canal — c’est gratuit