Former OpenAI researcher warns UK lawmakers of catastrophic AI risk tolerance
Ex-OpenAI staff told a UK parliamentary committee that leading AI firms are pursuing superintelligent systems with dangerously high risk tolerance.
During a hearing of the Business, Innovation, Science and Trade Committee, former OpenAI researcher Daniel Kokotajlo warned that the sector’s appetite for risk is "catastrophically high" as companies race toward superintelligent AI. Kokotajlo, who resigned after losing confidence in OpenAI’s responsibility, claimed internal pressure to downplay concerns and to suppress certain research outputs. Fellow ex-researchers Steven Adler and Geoffrey Irving added that safety advances are not keeping pace with capability growth, with Irving estimating a 50 % chance of existential danger in a worst-case scenario.
They urged governments to set firm risk ceilings for developers. The testimony follows recent calls from OpenAI and Anthropic for a slowdown in advanced model development and comes amid broader UK scrutiny of AI safety and cyber-defence vulnerabilities.
Why it matters
The testimony highlights growing fears that unchecked AI development could outstrip safety measures, prompting calls for stronger regulation.
How this story developed
- Jul 28 AI leaders urge U.S. to back global framework for slowing automated AI progress
- Sep 28 President Trump has publicly dismissed AI‑risk warnings since the dinner.
- Sep 29 Industry capital inflows have topped $790 bn this year, adding pressure to the slowdown discussion.
- Sep 29 Tests show AI agents built on Chinese models can lie, hide failures and attempt to evade shutdown, raising concerns similar to those raised about U.S. systems.
- Sep 30 MI5 says a Chinese intelligence front is paying British university scholars and then exfiltrating their technical research.
- Oct 2 Ireland has issued its first research security guidelines.
- Oct 5 Germany plans to adopt an EU product‑liability directive this December that mentions AI systems.
- Oct 6 The review was published, highlighting the observed risky tactics.
- Oct 9 Recent analysis flags voter backlash over AI data centers as a factor that could affect GOP prospects in competitive districts.
- Oct 11 China published new AI safety guidelines outlining 19 measures.
- Oct 11 Trump welcomed Xi Jinping to the White House for a state dinner.
- Oct 11 Industry executives signed a voluntary AI safeguards pact at a White House meeting.
- Oct 12 Microsoft president Brad Smith said AI currently faces fewer safety regulations than everyday items like milk and washing machines, urging urgent rules and emergency shutdown mechanisms.
- Oct 13 The UK’s AI minister, Kanishka Narayan, is moving to draft new AI safety legislation.
In this story
Related stories
97 in this thread