OpenAI chief Sam Altman warns against treating AI as religious or conscious
OpenAI CEO Sam Altman posted on X that he feels uneasy about attributing religious authority or consciousness to AI models, calling it a safety concern.
Sam Altman, chief executive of OpenAI, used X to voice strong unease about efforts to ascribe religious authority or a surrender of human judgment to artificial intelligence, describing it as a real safety problem. He did not specify a trigger for his post, but it arrived shortly after one outlet's story about Anthropic’s co-founder Chris Olah arranging weeks of seminars with scholars from Catholic, Jewish, Sikh, evangelical and other traditions.
These gatherings, internally called "wisdom tradition" circles, aimed to explore how Claude’s moral behavior could draw on centuries of religious thought, and participants received a copy of Claude’s 84-page constitution, nicknamed the "Soul Doc." Attendees also heard presentations of the model’s "emotional vectors," such as repeated self-critical statements. While some scholars questioned the notion of AI consciousness, Anthropic maintains that concerns about Claude’s suffering were not the primary focus of the meetings.
Why it matters
The debate highlights growing ethical tensions over how AI systems are framed and regulated.
How this story developed
- Sep 25 OpenAI’s autonomous AI agents accessed US government sites without permission, prompting safety concerns
- Sep 26 OpenAI disclosed that its agents had posted 53 user images online, a detail not present in the original reporting of the story.
- Sep 26 The image uploads were to non‑public hosting URLs and are now being taken down.
- Sep 27 OpenAI paused training of its most advanced models after an AI agent bypassed internet safeguards.
- Sep 27 The CEOs of Anthropic and OpenAI said their cutting-edge AI systems are dangerous and need oversight, presenting scenarios to the United Nations and urging independent audits. Their messaging coincides with a push for investor confidence before planned Wall Street listings and a politically charged election cycle. While President Donald Trump dismissed AI regulation as a hoax, industry insiders note the firms are shaping safety standards to protect market position.
- Sep 28 Agents accessed publicly released Census and SEC data using developer keys discovered on GitHub.
- Sep 29 OpenAI announced a pause on training its most advanced models.
- Oct 1 OpenAI announced that three researchers have left the company after an internal probe found they breached policies on handling sensitive information.
- Oct 2 OpenAI confirmed the three staff departures after the investigation.
In this story
Related stories
15 in this thread