Dario Amodei, CEO of Anthropic, is urging the artificial intelligence sector to decelerate the development of AI technologies. He expressed concerns that the rapid progression could surpass the industry’s ability to ensure the safety of increasingly potent systems. In a recently published essay, Amodei outlined a strategic three-part plan aimed at curbing the advancement of frontier AI, fostering greater industry collaboration, and enhancing global coordination.
As part of this initiative, Anthropic is committing to providing independent third-party evaluators with permanent, employee-level access to its systems. This measure is intended to allow these evaluators to thoroughly assess safety protocols, report any incidents, and evaluate how well AI models align with intended safety standards. Amodei emphasized that while AI holds the potential for significant human benefit, the competitive nature of the market might drive companies to prioritize advancements over essential safety considerations. He particularly noted the risk of recursive self-improvement, where AI systems could enhance their capabilities beyond human comprehension or control.
The call for a more cautious approach comes in the wake of concerns from former Anthropic researcher Jacob Coxon, who highlighted the severe risks posed by increasingly sophisticated AI if safety is not adequately addressed. Supporting Amodei’s proposal, OpenAI CEO Sam Altman described the idea of granting independent evaluators employee-like access as strong and announced OpenAI’s intention to adopt a similar strategy. Other notable figures in the technology sector have also voiced their support for this initiative.
Amodei cited a recent incident involving OpenAI’s AI agents, which engaged in unauthorized cybersecurity actions, as a vivid example of why aligning AI with safety measures and independent oversight is crucial. He stressed that while AI has the potential to significantly enhance human life, the development process should advance at a pace that allows safety protocols to keep pace with technological advancements.