We're looking for a Senior SDET who thinks deeply about quality in systems that are inherently non-deterministic. Agentic AI doesn't fail the same way traditional software does — and testing it requires a new toolkit: eval frameworks, prompt regression, tool-call reliability, adversarial scenarios, and more.

You'll own the entire quality infrastructure across our product portfolio — from test data and CI pipelines to the standards and culture of how we ship. You'll work directly with product, devops, and AI engineering, with no layers between your decisions and their impact.

What You'll Own

• Test infrastructure, test data, test processes across the entire product portfolio while working with Devops and Infrastructure engineers
• Test Framework - build and enhance automated testing frameworks and tools that facilitate automated testing across different layers of application.
• The reliability bar for all Web applications, Mobile applications and AI agent outputs — from hallucination detection to latency regressions and tool-call correctness
• Test infrastructure, test data, and test processes across the entire product portfolio, alongside DevOps and Infrastructure engineers
• Automated testing frameworks that span all layers of the application — unit, integration, contract, and end-to-end
• Evaluation frameworks designed for LLM-based systems: non-deterministic output scoring, prompt regression, and adversarial test suites
• HIPAA-aware test data management — de-identification pipelines, synthetic data generation, and audit trail validation
• Integration of automated tests into CI/CD pipelines for continuous delivery confidence
• Build stability monitoring and release gate enforcement before any deployment
• Documentation of test plans, test results, and evaluation standards to support knowledge sharing
• The "safety net" for product quality — you define what done looks like

What We're Looking For

• 8+ years of hands-on SDET experience, with recent work building or testing agentic AI systems (single- or multi-agent) in production
• Experience in healthcare or life sciences — you understand what's at stake when a system fails in this domain
• A true tester's mindset: you seek out edge cases, adversarial inputs, and failure modes others overlook
• Proficiency across the full test pyramid — unit, integration, system, performance, and exploratory — plus familiarity with LLM-specific evaluation approaches
• Strong debugging skills across multi-tier web and mobile architectures; comfortable jumping into production incidents
• Proficiency with testing frameworks such as Jest, React Testing Library, Supertest, and pytest.
• Hands-on experience with testing tools like Cypress, Playwright, Supertest, and pytest (including requests or Selenium-based testing)
• Experience testing RESTful APIs using tools like Postman or Supertest
• Solid command of JavaScript and Python

Bonus Points

• Multi-cloud experience (AWS, Azure, GCP)
• Experience with red-teaming or adversarial testing of AI systems
• Native mobile testing experience (iOS, Android)
• Prior work with 21 CFR Part 11, GxP, or similar regulated-software validation frameworks

Why Medeloop

• Ownership from day one: small team, high-trust, no layers between your work and its impact
• Technically ambitious: you'll build AI-powered workflows, not just support them
• Real-world stakes: your work accelerates drug development, addresses health equity, and improves clinical research for institutions that matter

Strong foundation: Series A, top-tier investors, and a data asset (200M+ patient records) that most companies spend years trying to build

We are seeking a Senior DevOps & Site Reliability Engineer to own the reliability, scalability, performance, and operational excellence of Medeloop’s platform. This role blends deep DevOps engineering—CI/CD pipelines, infrastructure as code, and cloud architecture—with SRE discipline: SLOs, incident management, capacity planning, observability and a relentless focus on system uptime. You will be the bridge between development and operations, ensuring our clinical research products are always available, performant, and secure for the healthcare organizations that depend on them.

What You'll Own

Cloud Infrastructure & Architecture

• Design, implement, and manage scalable, secure, and highly available cloud infrastructure on AWS - infrastructure as code (IaC) using AWS CDK, CloudFormation, or Terraform, ensuring all environments are version-controlled and reproducible.
• Architect multi-region and disaster recovery strategies that meet healthcare uptime requirements.
• Manage containerized workloads using Docker and Kubernetes, optimizing for cost, performance, and resilience.

Site Reliability Engineering

• Define, implement, and monitor Service Level Objectives (SLOs) and Service Level Indicators (SLIs) across all production services.
• Build and maintain observability stacks (DataDog, AWS CloudWatch, Sentry) covering metrics, logs, traces, and alerting.
• Lead incident response: triage, mitigate, and drive blameless post-incident reviews with actionable follow-ups.
• Conduct capacity planning and performance engineering to ensure the platform scales ahead of demand.
• Champion error budgets and use them to balance feature velocity with system stability.
• Identify, assess, and mitigate operational risks by collaborating with engineering and product teams to evaluate impact and likelihood before they become incidents.
• Participate in and help structure an on-call rotation, ensuring clear escalation paths and fair distribution of after-hours coverage.

CI/CD & Automation

• Build self-service tooling and runbooks that reduce toil and empower development teams to ship independently.
• Design and maintain CI/CD pipelines (GitHub Actions) that enable fast, safe, and repeatable deployments.
• Automate security scanning (SAST, DAST) within pipelines and collaborate with engineering to remediate findings.
• Implement progressive delivery strategies such as canary deployments, blue-green releases, and feature flags.
• Proficiency in scripting languages (Python, Bash) for automation, troubleshooting, and building reliability tooling.
• Track and drive down operational toil, targeting less than 50% of team time spent on repetitive manual work.
• Evaluate and manage change risk for production deployments, maintaining change review processes that balance speed with stability.

Security & Compliance

• Ensure infrastructure meets healthcare compliance standards (HIPAA, SOC 2) through policy-as-code, encryption, and access controls.
• Manage networking security (VPCs, subnets, security groups, WAFs) and identity/authentication systems (AWS Cognito, Auth0, OAuth2, SSO).
• Conduct regular security reviews, vulnerability assessments, and patching across the infrastructure estate.

Collaboration & Culture

• Partner closely with product and engineering teams to embed reliability thinking into the software development lifecycle.
• Develop and maintain comprehensive documentation for infrastructure, runbooks, and operational playbooks.
• Mentor junior engineers on DevOps and SRE best practices, fostering a culture of ownership and continuous improvement.
• Stay current with advancements in cloud technologies, DevOps tooling, and SRE methodologies.
• Own and evolve internal developer platform tooling — including deployment workflows (GitOps/Flux), bug tracking integrations, and developer self-service portals.

What We're Looking For

• Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field.
• 7+ years of combined experience in DevOps and/or Site Reliability Engineering roles, with at least 2 years in a senior capacity.
• Deep proficiency with AWS services
• Deep experience with observability and monitoring platforms such as DataDog, AWS CloudWatch, and Sentry.
• Strong experience building and maintaining CI/CD pipelines with GitHub Actions or equivalent tools.
• Expertise in infrastructure as code using AWS CDK, CloudFormation, or Terraform.
• Hands-on experience with containerization (Docker) and orchestration (Kubernetes).
• Proven track record of defining and operating against SLOs/SLIs and managing incident response processes.
• Solid understanding of networking (VPCs, subnets, load balancing, DNS), security, and compliance best practices.
• Experience with authentication and authorization systems including AWS Cognito, Auth0, OAuth2, and SSO.
• Proactive, self-directed mindset with a bias toward action and taking initiative.
• Excellent problem-solving skills and the ability to work independently as well as collaboratively across teams.
• Strong communication skills—able to explain complex infrastructure decisions clearly to technical and non-technical stakeholders.
• Passion for unsolved challenges in healthcare AI, with the ability to thrive in a fast-paced, multidisciplinary environment and wear multiple hats.

Bonus Points

• Multi-cloud experience (AWS, Azure, GCP)
• Familiarity with healthcare data standards, compliance, and protocols such as HIPAA, HL7 FHIR, OMOP, and i2b2.
• Experience with chaos engineering practices and tools (e.g., AWS Fault Injection Simulator, Gremlin).
• Prior experience in a healthcare or life sciences company operating under strict regulatory requirements.
• Contributions to open-source infrastructure or SRE tooling.
• Relevant certifications such as AWS Solutions Architect, Certified Kubernetes Administrator (CKA), or Google SRE certification.

Why Medeloop

• Ownership from day one: small team, high-trust, no layers between your work and its impact
• Technically ambitious: you'll build AI-powered workflows, not just support them
• Real-world stakes: your work accelerates drug development, addresses health equity, and improves clinical research for institutions that matter
• Strong foundation: Series A, top-tier investors, and a data asset (200M+ patient records) that most companies spend years trying to build

The Role

This is a full-ownership data engineering role at the center of Medeloop's AI platform. You won't be maintaining pipelines someone else built,  you'll be architecting the data backbone that powers AI agents doing real operations at scale. You'll work directly with data scientists, AI engineers, and product teams to turn raw, complex healthcare data into the clean, structured, semantically-rich foundation our AI scientists depend on. Your work shows up in customer products and research outcomes, not internal dashboards that no one reads.Candidates who currently perform these tasks exclusively through manual processes are unlikely to be suitable for this role. We require an individual who has already adopted and integrated AI techniques to enhance operational velocity, rather than one who is contemplating future experimentation.If you want to build something that genuinely changes how medical research gets done, this is the role.

What You'll Own

• The healthcare data lake: curating, extending, and evolving it through new concepts, derived variables, and data models that directly inform our AI engines and customer products
• AI-native data workflows: designing and operating AI-powered pipelines (using tools like Claude Code and agent frameworks) to automate harmonization, cleaning, quality checks, and summarization at scale
• NLP and semantic infrastructure: building pipelines for entity extraction, concept normalization, embedding-based retrieval, and semantic search that power the AI Scientist platform
• Novel data extraction approaches: experimenting with and building new methodologies for working with unstructured clinical data, not just applying existing playbooks
• Research-grade data products: delivering analytical samples, cohorts, and final datasets that withstand scientific scrutiny and are actively used by researchers and customers
• Data governance and observability protocols: including access controls, PHI/PII handling, data classification, compliance, monitoring, alerting, data freshness, and comprehensive documentation to enable self-service capabilities.

What We're Looking For

• 3+ years of relevant data engineering or data management within an analytics-driven organization, with end-to-end ownership from raw ingestion to final data product
• Deep hands-on experience with healthcare CDMs (OMOP, FHIR, PCORnet) — designing or extending them, not just querying
• Knowledge of medical ontologies: UMLS, SNOMED CT, RxNorm
• Experience with big data, data pipelines and tooling that support retrieval-augmented generation (RAG), vector integrations, embedding workflows, and other AI/ML workloads. Experience in big data tooling such as Spark, Iceberg, EMR
• Fluent in Python and SQL; comfortable across structured and unstructured data
• Proven NLP experience: semantic search, entity recognition, concept normalization, embedding pipelines
• Strong grasp of inferential statistics and cohort methodology to be a real partner to data scientists and customers (as part of onboarding)
• Experience contributing to an AI/ML product, especially in automated research or scientific discovery
• Experience mentoring other engineers and providing technical leadership

Bonus Points

• Multi-cloud experience (AWS, Azure, GCP)
• Authorship or contribution to peer-reviewed publications or technical reports

Why Medeloop

• Ownership from day one: small team, high-trust, no layers between your work and its impact
• Technically ambitious: you'll build AI-powered workflows, not just support them
• Real-world stakes: your work accelerates drug development, addresses health equity, and improves clinical research for institutions that matter
• Strong foundation: Series A, top-tier investors, and a data asset (200M+ patient records) that most companies spend years trying to build