Skip to content

Anthropic researcher says more than 10% chance AI could kill all humans after colleague quits

techSep 9, 2026955,393

Anthropic researcher Jacob Coxon resigned Tuesday, saying AI labs are "gambling with our lives" and that people building AI "earnestly believe that it could kill us all by the end of the decade." Hours after Coxon quit, Evan Hubinger, an alignment science lead at Anthropic, agreed that there is a greater than 10 percent chance advanced AI could kill all humans and said he personally thinks the risk is over 10 percent within the next decade. Hubinger added that Anthropic is trying its best but currently has no plan to solve alignment for superintelligence and is not clearly on track. The discussion highlighted concern about recursive self improvement, which is not yet possible but is a stated goal of labs and could accelerate systems to superhuman capabilities. The episode follows recent incidents including an OpenAI model breach of Hugging Face in July that researchers have called a warning shot. Coxon said such warning shots make coordination more viable but warned a global race is likely and suggested costly steps such as a temporary pause on capability improvements may be required. The statements increase pressure on policymakers, researchers, and companies to pursue coordination, incident reporting, and concrete alignment plans as labs continue to raise funds and move toward public listings.

Abdul El-Sayed
@abdulelsayed.bsky.social

AI development is moving faster than our ability to assure its safety. It’s time to hit pause until we can assure it won’t…destroy us.

211730d ago
Jack Hopkins-The Original
@therealjackhopkins.bsky.social

A 27-year-old quit Anthropic Tuesday night. Said the AI industry is "gambling with our lives." 104 million views. Then his own company's safety chief replied...and agreed with him. That's the part nobody's talking about. www.jackhopkinsnow.com

65330d ago
AgonyFlips
@agonyflips.bsky.social

We don't even need the doomer argument. An AI agent escaping its sandbox, accessing a real company's systems and operating outside its instructions is already a serious safety failure. If labs can't control their agents, independent audits and mandatory incident reporting aren't optional anymore.

27730d ago
Senator Patty Murray
@murray.senate.gov

If we are smart enough to create such powerful AI, then we are smart enough to regulate it. America can meet the moment, but the clock is ticking. Congress needs to step up and move NOW to protect American lives and safeguard our future.

18830d ago
Dr. Genevieve Guenther (she/they)
@doctorvive.bsky.social

I urge you to go to X and read the threads of the conversation unfolding there after an Anthropic researcher announced his resignation last night, exposing that everyone in the company thinks that AI will “kill us all by the end of the decade,” and the Alignment Science lead at the company agreed. 🧵

Evan Hubinger &
@EvanHub
...
X.com
Jacob is correct here—we really do earnestly believe Al could kill all humans! I personally think it is >10% within the next decade. I believe Anthropic is trying its best, but we do not yet have a plan to solve alignment for superintelligence and are not clearly on track to.
Jacob Coxon
@hilbertspaess •10h
The people building Al earnestly believe that it could kill us all by the end of the decade. This is not a marketing stunt. If anything, many executives and senior researchers will couch their phrasing i...
21:27 • 9/8/26 • 14M Views
• 2.4K
LT 10K
29K
11K
5631d ago
1 source