AI leaders call for development slowdown amid safety concerns and geopolitical rivalry
Top AI executives including Dario Amodei, Sam Altman and Elon Musk urged a slowdown in AI development, citing serious safety risks.
A rare consensus has formed among leading AI figures—Anthropic’s Dario Amodei, OpenAI’s Sam Altman, Elon Musk and others—who argue that the pace of artificial-intelligence advancement must be tempered to address existential risks. The discussion intensified after an Anthropic researcher quit, warning of severe dangers. Amodei’s essay outlines steps such as permanent on-site access for independent safety evaluators, a federal safety framework, and global agreements to ban the most hazardous AI applications and to cap recursive self-improvement speeds.
Altman praised the ideas and said OpenAI would adopt them without waiting for legislation. Critics note the difficulty of securing cooperation from rival nations, especially China, and warn that industry-driven standards could concentrate power. Nonetheless, some observers remain cautiously optimistic that the heightened attention could shift how success in AI is measured.
Why it matters
A slower AI rollout could lower catastrophic risks while reshaping industry incentives and global tech competition.
How the sides frame it
LOW AGREEMENTLeft-leaning coverage stresses the existential risks of AI and calls for a slowdown and regulatory frameworks, while right-leaning coverage frames AI safety as an engineering issue that can be managed without new regulations.
LEFT
AI leaders urge a development slowdown to address existential risks and call for federal safety frameworks and global agreements.
RIGHT
AI safety is presented as an engineering problem that can be handled through better testing environments, without the need for new regulations.
The left emphasises
- the need to temper AI advancement to address existential risks
- proposals for permanent on-site safety evaluators and a federal safety framework
- concerns about securing cooperation from rival nations such as China
The right emphasises
- safety is an engineering problem
- advocating pacing of AI development until labs have confidence in the product
- new regulations are not required
How this story developed
- Sep 9 Anthropic AI researcher resigns, citing existential danger of superintelligent systems
- Sep 9 Evan Hubinger disclosed that some Anthropic staff estimate a greater than 10% chance of human extinction from advanced AI within ten years.
- Sep 10 U.S. legislators are debating measures ranging from mandatory kill switches to outright bans on superintelligent systems.
- Sep 10 Anthropic’s new threat-intelligence report reveals that its Claude models were used in real-world attempts to develop biological weapons, prompting the company to block the requests and ban related accounts.
- Sep 10 Resignation meme spreads across X with satirical adaptations.
- Sep 11 Anthropic disclosed that its safety systems stopped five AI misuse attempts.
- Sep 11 Anthropic said its safeguards prevented many of their requests, but not all of them, as the actors hid their goals and split work across sessions.
- Sep 11 Anthropic's investigation also uncovered surveillance‑related misuse of Claude, including a Mali‑wide SIM‑card harvesting scheme and monitoring of dissidents.
- Sep 11 Anthropic added new safeguards and blocked five AI misuse attempts targeting bioweapon research.
- Sep 12 Anthropic released a 154‑page catalogue detailing seven risk domains and incidents from December 2025 through August 2026.
- Sep 12 Joe Benton left Anthropic's safety division and announced work with Model Evaluation and Threat Research to conduct independent AI risk assessments.
In this story
Related stories
16 in this thread