A 10% AI Extinction Estimate Is a Warning, Not a Forecast
What happened
On September 9, 2026, Anthropic (the AI company behind Claude) became the focus of a safety debate. Evan Hubinger, Anthropic's Alignment Science Lead, posted on X that he personally put the chance of AI killing all humans above 10% within the next decade. CBS News and BBC News reported the statement. This is not a report of an extinction event. It is a public judgment about a possible future.
The warning followed Jacob Coxon's resignation from Anthropic. Coxon said he had spent three years doing pretraining research at OpenAI and Anthropic. He accused both companies of racing toward self-improving superintelligence despite serious risks. Hubinger supported the concern. He said Anthropic was trying its best, but did not yet have a plan for solving alignment for superintelligence. He also said the company was not clearly on track to solve it.
What does above 10% mean?
It is Hubinger's personal estimate. It is not a measured result, an official Anthropic forecast, or proof that extinction will happen. Ten percent can be pictured as one out of ten imagined futures: 10 × 10% = 1. But no one can run the same future ten times. The figure communicates seriousness, not a precise timetable or mechanism.
It also does not mean today's Claude has a ten percent chance of killing everyone. The reports focus on future systems with much greater abilities.
The background
Superintelligence is still theoretical. It means an AI that could outperform humans across nearly all thinking tasks. Alignment is the problem of keeping an AI's goals and behavior consistent with human intentions.
BBC reporting says Hubinger has described risk from present models as low. His concern is a future system that uses its abilities to help build a smarter successor. If progress outpaces human understanding, testing and control could become harder. That is a scenario, not a demonstrated outcome.
Why the story matters
The source of the warning matters. Coxon spoke after leaving. Hubinger leads alignment work at Anthropic and publicly backed the concern. Their statements show that serious safety questions exist inside the debate. They do not independently prove the probability.
The practical question is whether safety research can keep pace with capability research. It also raises questions about who should evaluate frontier systems and whether private labs can set the pace alone. CBS reported that a U.K. government spokesperson said AI risks cross borders and that the U.K. would continue testing advanced models.
What is confirmed
The public record supports three basic facts: Coxon announced his resignation; Hubinger published the above-10% estimate; and Hubinger said a superintelligence alignment plan was not ready. The reports do not show that Anthropic formally adopted his number.
What remains unknown
The reports do not explain how Hubinger calculated the estimate, which failure paths he included, or when he expects superintelligence. They also do not establish whether such a system will be built. Anthropic's detailed response and safety plan remain important next evidence.
Hacker News attention
Two Hacker News submissions in this cluster drew substantial discussion. The candidate list records 42 points and 96 comments for the CBS story, and 44 points and 97 comments for the BBC story. Those numbers measure community attention. They do not verify the articles or Hubinger's estimate. See the CBS submission and BBC submission.
What to watch next
Watch for a detailed response from Anthropic and OpenAI, independent evaluations of advanced models, and government coordination. The key question is not whether one alarming number becomes a headline. It is whether labs can show credible safety work before future systems become harder to understand and control.