Jobs Companies Nextech Lead Software Engineer in Test – Agentic AI (Remote - US)

Über diese Lead Software Engineer in Test – Agentic AI (Remote - US) Stelle bei Nextech

Nextech · Remote · Remote
Why join Nextech?
 
We are a leader in specialty healthcare technology solutions.
 
We’re committed to hiring and retaining talent, which is why we invest in our employees through competitive pay, a generous bonus structure, great healthcare, a comprehensive wellness program, and many other benefits.
 
If you are a software engineer, finance or accounting professional, customer support specialist, or a business development expert with a passion for healthcare technology (just to name a few), we want to hear from you.
 
We are an equal opportunity employer with a commitment to diversity.  All individuals, regardless of personal characteristics are encouraged to apply. If you are a candidate in need of assistance or an accommodation in the application process, please contact [email protected].

Job Summary:
 

The Lead Software Engineer in Test – Agentic AI is responsible for leading quality engineering strategy and execution across next-generation AI-powered applications and distributed systems. This role drives the design of scalable automation frameworks, validates complex AI agent behaviors, and ensures high-quality delivery across UI, API, backend, and AI orchestration layers.

 

All activities must be performed in compliance with Equal Employment Opportunity (EEO) laws, HIPAA, ERISA, and all other applicable regulations.

Essential Functions

  • In addition to adhering to Nextech’s conduct and behavioral standards, responsibilities include:

  • Design, develop, and maintain scalable automation frameworks and regression test suites across UI, API, backend, and AI-driven applications.
  • Lead quality engineering initiatives for Agentic AI systems, including LLM workflows, RAG pipelines, autonomous agents, and distributed orchestration platforms.
  • Validate complex AI agent behaviors such as multi-agent coordination, tool calling, prompt chaining, memory retention, conversational workflows, and fallback/retry mechanisms.
  • Develop and execute functional, integration, regression, end-to-end, and performance testing strategies across cloud-native and distributed environments.
  • Collaborate with Software Engineers, Product Managers, and DevOps teams to integrate testing throughout the software development lifecycle.
  • Build reusable automation solutions to validate APIs, orchestration layers, asynchronous workflows, enterprise integrations, and AI-driven business processes.
  • Design and maintain robust test environments, CI/CD integrations, cloud execution platforms, and automation pipelines to improve efficiency and reliability.
  • Establish and drive best practices related to code quality, maintainability, scalability, dependency injection, observability, and testability.
  • Lead validation efforts for AI workflow resiliency, distributed system reliability, data consistency, and orchestration performance under failure and edge-case conditions.
  • Mentor QA engineers and contribute to the development of scalable QA standards, automation strategies, reporting practices, and continuous improvement initiatives.
  • Minimum Requirements

  • Bachelor’s degree in Computer Science, MIS, Engineering, or a related technical field.
  • 8+ years of experience in Software Development or Software Engineer in Test (SDET/SET) roles.5+ years of hands-on experience developing automation frameworks using JavaScript/TypeScript or Java.
  • Strong experience with automation tools such as Playwright, Cypress, Postman, K6, or equivalent frameworks.2+ years of experience testing AI-powered applications, LLM systems, Agentic AI platforms, orchestration frameworks, or autonomous workflows.
  • Hands-on experience validating agent orchestration workflows, conversational AI applications, multi-step reasoning systems, and AI-driven business processes.
  • Experience testing AI orchestration frameworks such as LangGraph, CrewAI, AutoGen, Semantic Kernel, or similar technologies.
  • Strong expertise in API testing, backend integration testing, UI automation, and end-to-end workflow validation.
  • Solid understanding of automation architecture, design patterns, anti-patterns, dependency injection, and inversion of control principles.
  • Experience working in cloud-native and containerized environments (Azure, AWS, GCP, Docker, Kubernetes).Proven experience integrating automated test suites into CI/CD pipelines and distributed cloud environments.
  • Experience validating asynchronous, event-driven, and distributed systems with a focus on resiliency and fault tolerance.
  • Strong analytical, debugging, troubleshooting, and problem-solving skills.
  • Excellent organizational, communication, and stakeholder collaboration skills in Agile environments.
  • Experience with AI observability, telemetry, RAG pipeline validation, vector databases, or prompt evaluation frameworks (preferred).
  • Preferred Qualifications

  • Experience with Azure DevOps, GitHub Actions, or similar CI/CD platforms.
  • Experience with AI observability tools, telemetry platforms, and prompt evaluation frameworks.Experience validating RAG pipelines, vector databases, and AI response accuracy.
  • Knowledge of healthcare systems, HIPAA compliance, and regulated enterprise environments.
  • Experience with event-driven architectures, messaging systems, and distributed data platforms (including SQL Server).
  • Prior experience leading QA teams, mentoring engineers, and implementing enterprise test reporting and quality metrics practices.
  • Work Environment/Physical Demands

  • Remote work
  • Activities require a significant amount of work in front of a computer monitor.

  • Total Rewards: 
    Generous annual bonus opportunity
    401(k) with Employer Match
    Flexible Time Off: take time off when you need it without worrying about available hours
    11 paid holidays 
    Your Day Your Way - Celebrate a day of cultural or social significance to you
    Access to Linkedin Learning courses for professional development
    Insurance: Choice of Medical, Dental, and Vision plans
    Health Savings Account with employer match
    Flexible Spending Account
    100% Company-Paid Parental leave (After 6 months with the company)
    Company-Paid Life Insurance and Short/Long Term Disability Insurance
    Nextech Luminary Peer Recognition Program
    Employee Assistance Program with free counseling sessions available
    Corporate Discounts on Retail, Travel, and Entertainment
     
    Bereit, sich bei Nextech zu bewerben?
    Bei Nextech bewerben

    Ähnliche Jobs

    Stitch Fix
    Lead Engineer - Product Catalog Team
    Stitch Fix
    ⚡ Früh bewerben Remote, USA · standortgebunden $125,000–$186,000
    ● Neu 👁 Gesehen ✓ Beworben vor 3 Std.
    MS
    Staff Mission Lead Systems Engineer - Classified Missions
    Muon Space
    ⚡ Früh bewerben Northern VA or Aurora, CO Vor Ort $177,000–$246,000
    ● Neu 👁 Gesehen ✓ Beworben vor 4 Std.
    MS
    Senior Mission Lead Systems Engineer
    Muon Space
    ⚡ Früh bewerben Remote · standortgebunden $159,000–$219,000
    ● Neu 👁 Gesehen ✓ Beworben vor 4 Std.
    Ōura
    Technical Lead Manager, Content Management Systems
    Ōura
    ⚡ Früh bewerben Remote - United States · standortgebunden
    ● Neu 👁 Gesehen ✓ Beworben vor 4 Std.
    CR
    Lead Engineer - AI Agent Voice Experience
    Cresta
    ⚡ Früh bewerben United States (Remote) · standortgebunden $205,000–$270,000
    ● Neu 👁 Gesehen ✓ Beworben vor 5 Std.
    Loadsmart
    Site Reliability Engineer, Tech Lead
    Loadsmart
    ⚡ Früh bewerben São Paulo / Remote · standortgebunden
    ● Neu 👁 Gesehen ✓ Beworben vor 6 Std.
    Samsara
    Lead Machine Learning Engineer - ML Infrastructure
    Samsara
    ⚡ Früh bewerben Remote - US Hybrid $200,200–$357,500
    ● Neu 👁 Gesehen ✓ Beworben vor 6 Std.
    Samsara
    Lead Machine Learning Engineer - ML Infrastructure
    Samsara
    ⚡ Früh bewerben Remote - Canada Hybrid CA$196,000–CA$269,500
    ● Neu 👁 Gesehen ✓ Beworben vor 6 Std.
    Samsara
    Tech Lead Applied Scientist
    Samsara
    ⚡ Früh bewerben Remote - US Hybrid $200,200–$357,500
    ● Neu 👁 Gesehen ✓ Beworben vor 6 Std.

    Registrieren für Vorschläge, die auf die von Ihnen geöffneten Jobs und gespeicherten Suchen zugeschnitten sind.

    Mehr Jobs bei Nextech

    Alle Jobs bei Nextech ansehen →

    Jetzt bewerben
    🤖

    Moment — langsam

    JobsRadar wurde für echte Menschen gebaut, die eine schwere Zeit bei der Jobsuche haben — nicht für automatisierte Anfragen. Sie klicken viel zu schnell und sind jetzt vorübergehend blockiert.

    Kommen Sie später wieder. Wenn Sie wirklich auf Jobsuche sind, stehen wir hinter Ihnen — verhalten Sie sich einfach wie ein Mensch.

    Catch your next role the second it’s posted.

    Create a free account and we’ll watch the boards for you — the instant a job matches your search, it lands in your inbox or Telegram. No digging, no refreshing.

    Create free account

    Free forever · takes 30 seconds · already have one?

    Verschaffe dir einen Vorsprung bei der Jobsuche.

    Tritt unserem Telegram-Kanal bei für das, was dir hilft, die Stelle zu bekommen — Gehaltsbenchmarks, den wöchentlichen Marktpuls und neue Feature-Drops. Kein Spam, nur Signal.

    Dem Kanal beitreten — kostenlos