(Senior) AI Governance Researcher

3 мес. назад

United KingdomUnited StatesWorldwideSeniorOnsite

research

Research and provide advice on AI governance, risk management, and legal implications to mitigate frontier AI system threats.

О компании

The Governance team conducts research and provides advice on the institutional, legal and strategic implications of AI scheming and loss of control threats, working closely alongside our Science of Scheming , Evaluations, and Monitoring teams. 
We work on a bet: that the governance, risk management and legal frameworks developed and implemented within and outside frontier labs in the next two years will contribute to determining our collective ability to stay in control of increasingly advanced AI systems. That means we focus on researching some of the hardest open problems in the field: scheming, loss of control, the governance of models deployed internally by frontier labs, government testing of frontier AI for high-stakes usage, and the imminent handoff of AI research and development to AIs themselves.
Within our broader governance efforts , our research outputs include the loss of control chapter of the International AI Safety Report 2026 , the landmark report AI Behind Closed Doors: A Primer on the Governance of Internal Deployment , The Loss of Control Playbook: Degrees, Dynamics, and Preparedness , a TIME op-ed with Yoshua Bengio , peer-reviewed work on precursory capabilities, AI incident regimes and National Security Benchmarks for Loss of Control presented at ICML, IASEAI and the UK AISI’s Conference on Frontier AI Safety Frameworks. We are routinely requested to brief members of governments on both sides of the Atlantic, including members of Congressional committees, the intelligence community and offices of Members of Congress. A portion of our work is non-public, written for de
The work. Everyone on the Governance team is empowered and well-supported to conduct independent, high-quality research on the most consequential open questions raised by advanced AI and associated threats. Our research priorities to date have covered are threat modelling and mitigations for loss of control, the governance of internal deployment, and developing safe step changes towards automated AI R&D (with a particular interest in AI handoff). You can learn more about our work here and here .

Обязанности

We are excited about individuals that would flourish pursuing the following:
Design and drive innovative AI governance research, targeting critical areas for AI safety and security, where mission success is not negotiable, such as AI R&D pipelines within frontier AI companies and national security. 
Lead research across formats appropriate to the questions, including peer-reviewed papers, in-depth reports, technical memos, and legal analyses. 
Scope out ambitious and forward-looking AI governance research projects and ideas grounded in the technical state of the art of AI safety and security. 
Engage with and contribute to shaping relevant legal, policy and governance frameworks alongside partners in companies and governments. 
Engage seriously with the technical literature on AI safety and with our colleagues' empirical work, translating it into governance-relevant research and proposals.
Contribute to and support existing research streams, led by colleagues.

Требования

We are looking for a mid-level to senior-level AI governance researcher. We expect candidates to thrive in this role if they match some or all features below: 
Essential : A minimum of 6 years work experience, coming from academia, industry, and/or private practice.
A track record of substantive research outputs that shifted thinking in their field, for example, peer-reviewed publications, high-impact reports, a relevant PhD thesis, or comparable work.
Demonstrated ability to scope and deliver an end-to-end research project, from problem identification through to a published artefact.
Be able to sustain start-up speed and be an effective team member in a high-growth and mission-driven environment, with a high bar for both intellectual rigour and real-world relevance. 
Excellent written communication, including the ability to write for both technical experts and decision-maker audiences.
Willingness to sail uncharted territory and be comfortable with ambitious projects and questions that are hard to tackle. 
Desirable : Strong judgement on which questions matter and the willingness to pursue them rigorously even when answers are uncertain.
Previous engagement with fields applicable to AI governance, including but not limited to, e.g., risk management, law, technical AI safety, cybersecurity, or institutional design.
An enjoyment for brainstorming and blue-sky thinking with colleagues and partners across organizations on the implications of future powerful AI systems and how society can build preparedness for what is coming.  
Ability to leverage a network and set of expertise that would complement Apollo Research’s existing network and expertise.
We'll assess fit on individual merit and can tailor scope and title for the right person.

Условия

This role offers market competitive salary, equity, and competitive benefits.
Salary: 150-225k USD
Flexible work hours and schedule
Unlimited vacation
Unlimited sick leave
Up to 6 months of paid parental leave
Comprehensive health, dental and vision insurance
Retirement savings with competitive employer matching (e.g. 401(k) for US employees)
Lunch, dinner, and snacks are provided for all employees on workdays
Paid work trips, including staff retreats, business trips, and relevant conferences
A yearly $1,000 (USD) professional development budget

Другое

Apollo Research is a mission-driven startup committed to reducing the threats from scheming frontier AI systems. We work with and are trusted by every frontier AI lab. We do fundamental research, test their models before deployment, and collaborate with them on scheming mitigations.
 
Start date: We aim to finalize a hire as soon as possible. We will review submissions on a rolling basis and reach out when a strong fit emerges. 
Time Allocation: Full-time
Location: This is an in-person role in our London or SF office. We offer flexible working hours and work-from-home arrangements.  
Visa sponsorship: We sponsor visas in the UK and US. Sponsorship isn't guaranteed for every role or candidate, but if we make you an offer, we'll work with you to find the right visa route.