Epoch AI

Financial Planning and Analysis

• Manage finance operations such as reviewing payment requests and disbursing payments
• Manage Mercury and credit card operations, ensuring compliance of expense policies
• Track and support various sub-budgets like team budgets, restricted grant budgets etc.
• Keep books accurate and current in QuickBooks Online
• Coordinate with external accountants and invoice clients
• Prepare for and coordinate the annual audit
• Own financial SOPs and accounting policy, support internal controls

Finance Specialist – Manager

Researcher

• Review benchmarks: Assess a new benchmark at least every two weeks. You’ll evaluate their methodology and what a 'good performance' would imply about AI capabilities.
• Publish and maintain reports: Write up public-facing reports on new benchmarks and periodically update them as new versions release and models make progress.
• Dig into data: Examine individual tasks within benchmarks in detail, using coding agents to assist while retaining your own critical oversight.

Researcher – Benchmark Reviews

• Create and curate an evaluation suite. Find real-world tasks that serve as challenging tests for practical AI capabilities, and update the tasks over time as AI capabilities evolve. Devise rubrics for evaluating AI performance.
• - Evaluate AI systems. Regularly evaluate new, notable AI models and products on the task suite. Update tasks and rubrics to reflect the changing landscape of AI capabilities.
• - Communicate your research. Create public-facing reports, blog posts, and data visualizations with your observations. Ensure the evaluations feed into our other research topics and help keep our team informed.
• - Conduct data analysis. Analyze evaluation results and compare models across tasks.
• - Improve the process. You might automate parts of the workflow, and build out parts of the evaluation into standalone benchmarks.

Researcher, Evaluations

Full-stack Engineer

• Implement benchmarks: Implement AI benchmarks within our evaluation infrastructure (primarily using the Inspect library) to expand the suite of capabilities we track. Develop our existing suite of benchmarks so we can quickly and painlessly evaluate new model releases.
• Develop new benchmarks: Contribute to the development of brand new benchmarks. You will have the opportunity to pitch and prototype your own ideas in addition to helping out with existing projects.
• Collaborate: Work closely with researchers, analysts, and other engineers at Epoch AI to ensure evaluation data and outputs are accurate, insightful, and effectively integrated into our research products and publications.

Software Engineer, Benchmarking

Product Designer

• Define and own strategy across our website and data products
• Establish design processes and quality standards for the organization
• Lead design projects end-to-end, from problem definition through delivery
• Design responsive user interfaces, graphs, and data visualizations
• Conduct user research to help us understand audience interests and how they use our research
• Create design specifications, mock-ups, and prototypes while contributing to our design library
• Manage and mentor another designer and part-time contributors

Finance Specialist – Manager

Researcher – Benchmark Reviews

Researcher, Evaluations

Software Engineer, Benchmarking

Senior Product Designer