About the role
Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.
Anthropic's Responsible Scaling Policy
Last summer we published our first Responsible Scaling Policy (RSP), which focuses on addressing catastrophic safety failures and misuse. In adopting such a policy, our primary goal has been to help turn high-level safety concepts into practical policies for fast-moving technical organizations and demonstrate the viability of these measures as possible standards.
Our Responsible Scaling Policy has been a powerful rallying point with many teams' work over the last six months connecting directly back to major RSP workstreams. The progress we have made has required significant work from teams across Anthropic and there is much more work to be done. Our new Responsible Scaling Team will:
Help leadership align on a practical approach to scaling responsibly that will raise the safety waterline in industry, inform regulation, and mitigate catastrophic risks from models
Rally teams internally to operationalize and implement this technical roadmap and set of high-level commitments, making object level decisions as needed
Iterate internally on different approaches to safety challenges, feeding these learnings back into the high-level policy, and sharing our learnings with industry and policymakers
As we continue to iterate on and improve the original policy, we are actively exploring ways to incorporate practices from existing risk management and operational safety domains. While none of these domains alone will be perfectly analogous, we expect to find valuable insights from nuclear security, biosecurity, systems safety, autonomous vehicles, aerospace, and cybersecurity. We intend to build an interdisciplinary team to help us integrate the most relevant and valuable practices from each.
About this Team
We are a rapidly growing, multidisciplinary team working to operationalize Anthropic's Responsible Scaling Policy (RSP) and implement cutting-edge safety measures across the organization. Our work spans threat modeling and AI safety evaluations, technical and operational risk mitigation, and governance frameworks for responsible AI development. We are looking for exceptional individuals with a passion for AI safety and a track record of driving impactful change. As our team continues to expand, we anticipate a range of opportunities across our core RSP workstreams:
Capacity Evaluations: Designing and executing rigorous testing frameworks to proactively identify and assess potential risks in Anthropic's AI systems
Safety Mitigations: Translating AI safety principles into practical, implementable measures and driving the development and rollout of cutting-edge safeguards
Risk Management & Governance: Providing independent oversight and assurance to ensure Anthropic's RSP commitments are upheld with the highest degree of integrity
We are not currently hiring Generalists, as we are focused on hiring leads for each of these two work streams: Safety Case Specialist (Capability Evaluations) and Safety Case Specialist (Safety Mitigations). However, we are always eager to connect with talented individuals who share our mission and values. If you have a strong technical background, exceptional project management or systems engineering skills, and a demonstrated commitment to AI safety, we would love to hear from you. By submitting an application here, you’ll be among the first to know about new opportunities on the Responsible Scaling Team as they become available.
Note: We will consider all candidates who can meet the organization's hybrid policy, provided you have significant (60%+) overlap with Pacific Time.
About the company
Anthropic is a public benefit corporation headquartered in San Francisco. We offer competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and a lovely office space in which to collaborate with colleagues.