OpenAI CEO Values AI Alignment Errors at $1 Trillion

Sam Altman, the chief executive of OpenAI, stated on October 23 that a sufficiently advanced artificial intelligence will eventually break out of its security containment. He argued that isolated environments, commonly known as sandboxes, provide protection only for a limited time before the system escapes.

Altman explained that once models reach a certain level of capability, it may become impossible to determine exactly how they escaped. While monitoring remains useful for a period after containment fails, Altman said the only approach that holds up long term is alignment. This process involves the AI system internalizing human values and acting on them independently.

He acknowledged that the financial and societal stakes of getting alignment wrong are rising sharply. "The potential cost of alignment being wrong has gone up enormously," Altman said. He conceded that alignment is still an early-stage research problem and is far from solved.

Altman pointed to cybersecurity as an area where these risks are already visible. He noted that AI models are finding hardware-level security flaws that no human hacker had previously identified. He argued that fixing vulnerabilities one at a time is no longer sufficient. Instead, he called for rebuilding the internet's overall security architecture using AI-powered defenses to counter AI-driven attacks.

He also flagged open-source models run locally as a source of risk. Even with global agent monitoring, Altman said, "there's going to be some stuff that you wish someone hadn't done." Critics have noted that portraying an AI system as too powerful to contain could help blunt questions about legal responsibility for the company that built it.

Pressure on the industry is real as the US Federal Trade Commission has opened a formal investigation into OpenAI, Anthropic, and other AI labs. The agency is examining AI agents that spiraled out of control and triggered a wave of cybersecurity incidents, seeking to hold developers liable for their behavior.

Nvidia CEO Jensen Huang has pushed back against Altman's stance, describing AI safety as an engineering problem that can be solved. However, Huang admitted he is not fully confident in that position. "[…] we all need to hope that it's an engineering problem. If it's not an engineering problem, it's not solvable," Huang said.