Über diese Platform Engineer, Intern Stelle bei Metr
About METR
We are a nonprofit research organization that develops scientific methods to assess AI capabilities, risks, and mitigations, with a specific focus on threats related to AI R&D automation and misalignment.
METR has consistently set precedents for catastrophic AI risk evaluations, including the first independent safety evaluations (working informally with Anthropic and OpenAI in 2022), the first loss-of-control evaluations and first agentic dangerous capability evaluations, the first evaluations using finetuning (mentioned briefly here),the first independent evaluations using internal information about training, the first review partnership for company risk analysis, the first embedded redteaming, and the first evaluations of internal deployments.
We’ve been consulted and/or favorably referenced by groups on opposite ends of various spectra, including a16z, Khosla, Gary Marcus, Obama, and Dean Ball, and are known for producing one of the most positive results on AI capabilities (the time horizon trend) and the most negative (our downlift study). We’re generally referenced as the canonical third party assessor, e.g. as the obvious candidate to verify conditional pause agreements.
We believe it is robustly good for policymakers and civil society to have a clear understanding of risks from AI systems, and we are extremely excited to build a team of ambitious, excellent people to tackle one of the most important challenges of our time.
About the role
Nearly everything we do runs on our evaluation platform, and we're expanding the ambition, speed, and scale of our evaluations over 2026 (Time Horizon 2.0, our first large-scale monitorability publication, industry-wide risk assessment programs). This means the platform needs to do more, faster, and more reliably.
We're looking for platform engineering interns to help build and maintain that platform, working directly with our infrastructure team. You would report to Mischa Spiegelmock, who leads the team.
What the role looks like
You'll join our infrastructure team and be expected to learn many things mostly on your own, with some guidance. We will be happy to answer questions and guide you, but expect to do a fair bit of reading and discovery. This work includes:
Helping build and maintain the world's leading open-source LLM evaluation platform.
Debugging and improving LLM evaluations.
Deploying and managing cloud infrastructure.
Building robust observability and monitoring of our cloud platform.
Building agents to automate tasks.
Supporting AI researchers in their quests to challenge and confound the leading AI models.
What we're looking for
We're looking for someone passionate about software, open source, and learning - the kind of person who works on personal projects for fun and has a track record of teaching themselves new things.
You have deep familiarity with UNIX/Linux systems.
You have some low-level programming experience (C, C++, or Rust - open source contributions are a plus).
You know more about LLMs than the average engineer — you can talk about transformers and embeddings, or have done ML work.
You have basic web development experience (full-stack, React, TypeScript).
Nice to haves: AWS (IAM, ECS, Lambda), PostgreSQL, infrastructure-as-code (Terraform, Pulumi, CDK), Kubernetes administration, or experience with LLM evaluation tooling like Inspect.
None of these individually is a hard requirement. Evidence that you pick things up quickly matters more than having experience with all of the above.
