METR

Research Scientist

• We're seeking a researcher to help us better understand AI capabilities.
• Previous work in this vein includes agent time horizons, a commonly-used metric for measuring AI progress, and RCTs on open-source developer productivity.
• Lead a project investigating transcripts as a source of evidence about agent capabilities.
• Improve METR's time-horizon metric to make it more externally valid, more interpretable, and more predictive on threat-model relevant capabilities.
• Design and build experiments testing agent capabilities in the wild.
• Lead large-scale human-subjects experiments measuring the impacts of AI agents on economically-valuable R&D.

Senior Research Engineer / Research Scientist