Irregular
Technical Policy Researcher
11mo ago
Worldwidethreat modelingresearchpolicy proposalsquantitative researchqualitative researchacademic writing
Researcher focusing on AI security policy, threat modeling, and mitigation strategies.
Requirements
- Strong research skills in both quantitative and qualitative methods.
- Strong writing skills, and experience as an academic (or industry equivalent) writer or analyst.
- Interest in AI and specifically AI security.
- Technical proficiency.
- Background in AI/cybersecurity - a big advantage
Other
- About Irregular Irregular is the first frontier security lab with the mission of protecting the world in the time of increasingly capable and sophisticated AI systems. We build next-generation defenses through high-fidelity research platforms that simulate and monitor real-world AI security scenarios.
- As AI systems become more powerful, we focus on staying ahead of emerging threats and vulnerabilities, ensuring these transformative technologies can be deployed safely and securely. About the Role As a Technical Policy researcher at Irregular, you'll tackle some of the biggest and most complex questions of AI development and deployment. Your work outlining problems, solutions and principles for governments, frontier labs, and deployers will shape the emerging field of AI security.
- Threat modeling and fleshing out in what specific way could a strong cyber-capable model cause harm.
- Taxonomies for dangerous AI capabilities or mitigations.
- Policy proposals for models' refusal policy (which prompts models should refuse to follow).
- Following up on publications and news on AI policy, AI risks and mitigations, and technical AI research.
- Writing academic papers and blog posts detailing our research around evaluation theory or mitigation recommendations.
- Publishing your research and/or delivering research to our customers.