Anthropic researcher Jacob Coxon quits over AI extinction risk

Jacob Coxon resigned from Anthropic on September 9, 2026, warning that self-improving AI systems pose an existential threat to humanity and calling both OpenAI and Anthropic reckless. He advocated for industry pacing agreements and regulatory oversight before catastrophic risks materialize.

23 reportsother · tech · international · us_mainstream

Claim audit

No BS check run yet — press ⚖ to extract this story's claims and verify them against independent sources.

All coverage

Anthropic researcher Jacob Coxon resigned over AI extinction fears, calling for pacing agreements between labs. https:// techcrunch.com/2026/09/09/gamb ling-with-our-lives-anthropic-researcher-quits-w

mastodon:mstdn-socialother20d ago kagi ↗

Anthropic researcher Jacob Coxon resigned over AI extinction fears, calling for pacing agreements between labs. https:// techcrunch.com/2026/09/09/gamb ling-with-our-lives-anthropic-researcher-quits-warns-against-self-improving-ai/?utm_source=dlvr.it&utm_medium=mastodon

AI researcher quits Anthropic over superintelligence fears: ‘gambling with our lives’

rss:scmpinternational20d ago kagi ↗

An artificial intelligence researcher who left OpenAI to join Anthropic has decided to leave the industry, accusing both US companies of “gambling with our lives” in the race to develop AI models capable of self-improvement. Jacob Coxon, 27, spent the past three years pretraining AI models, first at OpenAI and then, this year, at its rival Anthropic, which he considered more cautious in its approa

[wiki Δ+2693] Jacob Coxon

stream:wiki-eventsother20d ago kagi ↗

Terabyte646: ← Created page with ''''Jacob Coxon''' is an American technology researcher who previously worked at artificial intelligence companies OpenAI and Anthropic .<ref>{{Cite news |last=Ramkumar |first=Amrith |date=2026-09-08 |title=Exclusive {{!}} Anthropic Researcher Quits Over ‘Out-of-Control’ AI Fears |url=https://www.wsj.com/tech/ai/anthropic-researcher-quits-over-out-of-control-ai-fea

Anthropic researcher quits, warns on self-improving AI

kite:techother20d ago kagi ↗

Anthropic researcher Jacob Coxon resigned, saying he spent three years on pretraining research at OpenAI and Anthropic and no longer wanted to participate in what he described as a race toward self-improving superintelligence [techcrunch.com#2][bbc.co.uk#1][dawn.com#1][insiderpaper.com#1]. Coxon said both companies were “gambling with our lives” and warned that future systems could become “superhu

Anthropic researchers warn AI poses more than 10% extinction risk

kite:businessother19d ago kagi ↗

Jacob Coxon resigned from Anthropic after three years in pretraining research at OpenAI and Anthropic, accusing both companies of racing toward self-improving superintelligence and “gambling with our lives” [cbsnews.com#1][theguardian.com#1][scroll.in#1][arstechnica.com#1]. Anthropic alignment science lead Evan Hubinger backed Coxon’s warning on X, saying he personally saw a greater than 10% chanc

Anthropic researcher quits, warns AI could kill humanity

kite:usaother19d ago kagi ↗

Jacob Coxon, a 27-year-old AI researcher who worked on pretraining at OpenAI and Anthropic over the past three years, resigned from Anthropic and accused both U.S. companies of irresponsibly pursuing self-improving superintelligence [scmp.com#1][theguardian.com#1][deccanchronicle.com#2][tribune.com.pk#1][npr.org#1][pbs.org#2]. In posts on X, Coxon said the companies were “racing straight to self-i

Former Anthropic researcher prompts calls for AI rules

kite:aiother19d ago kagi ↗

Former Anthropic researcher Jacob Coxon publicly resigned on Sept. 8 after working for three years on pretraining research at OpenAI and Anthropic, accusing both companies of moving too quickly toward self-improving superintelligence without adequate safeguards [cbsnews.com#1][cnet.com#1][thebhutanese.bt#1][aktuality.sk#2]. Coxon said people building advanced AI “earnestly believe” it could kill a

Former Anthropic researcher resigns, warns on AI safety

kite:scienceother19d ago kagi ↗

Jacob Coxon, a former OpenAI and Anthropic researcher, resigned from Anthropic this week and accused Anthropic and OpenAI of moving too quickly toward self-improving superintelligence. He said people building AI believe it could kill all humans by the end of the decade [zmescience.com#1][wzmq19.com#1][cbsnews.com#1][nationalpost.com#1]. Coxon said future systems could hack critical infrastructure,

Ex-Anthropic researcher criticizes AI safety controls after resigning

kite:techother18d ago kagi ↗

Jacob Coxon, a 27-year-old AI researcher who worked on pretraining at OpenAI and Anthropic, resigned from Anthropic after accusing both companies of pursuing advanced, self-improving AI systems without adequate safety controls [npr.org#1][cnet.com#1][securityweek.com#1][thenationalnews.com#1][cbsnews.com#1]. Coxon said rapidly advancing capabilities and unresolved control problems led him to quit

Anthropic models AI growth and job losses by 2030

kite:economyother18d ago kagi ↗

Anthropic’s economics team released a technical paper and interactive tool on Sept. 9 modeling how artificial intelligence could affect U.S. growth, wages and jobs by 2030. The task-based framework treats work as activities AI can leave unchanged, assist, automate or newly create [euronews.com#1][euronews.com#2][cio.com#1][fortune.com#1]. The authors said the scenarios are not forecasts and assign

President Trump dismisses AI extinction fears as researchers warn

kite:techother18d ago kagi ↗

President Trump dismissed concerns that artificial intelligence could cause human extinction, saying his priority was keeping the United States ahead of China in AI development. He made the comments on Sept. 10 while speaking with reporters at Dallas Fort Worth International Airport [politico.com#1][yna.co.kr#1]. The debate intensified after former Anthropic researcher Jacob Coxon said he resigned

President Trump dismisses AI extinction warnings as lawmakers seek rules

kite:usaother17d ago kagi ↗

A warning by former Anthropic researcher Jacob Coxon that leading AI companies are racing toward self-improving superintelligence has brought the prospect of catastrophic AI harm into U.S. political debate. Coxon resigned on Sept. 9 after working on pretraining research at OpenAI and Anthropic. He wrote that neither company was acting responsibly and was “gambling with our lives” [pjmedia.com#1][r

AI safety warnings intensify as labs debate development slowdown

kite:businessother17d ago kagi ↗

Warnings from current and former researchers at Anthropic and OpenAI have pushed AI safety and regulation into public and political debate. Jacob Coxon, who previously worked at both companies, said after leaving Anthropic that AI developers were “gambling with our lives.” Anthropic alignment researcher Evan Hubinger said he estimated at least a 10% chance that AI could kill all humans within the

AI researchers warn of extinction as Trump rejects risk concerns

kite:aiother17d ago kagi ↗

Researchers at Anthropic and OpenAI have publicly warned that the race toward increasingly capable, potentially self-improving AI systems could threaten human survival. Anthropic researcher Jacob Coxon resigned and wrote that AI companies were “racing straight to self-improving superintelligence and gambling with our lives”; Anthropic alignment lead Evan Hubinger endorsed the warning and said he d

Jacob Coxon on X: "I resigned from Anthropic today. I spent the last three years doing pretraining research at both OpenAI and Anthropic. Neither company is acting responsibly. They are racing straigh

mastodon:mstdn-socialother17d ago kagi ↗

Jacob Coxon on X: "I resigned from Anthropic today. I spent the last three years doing pretraining research at both OpenAI and Anthropic. Neither company is acting responsibly. They are racing straight to self-improving superintelligence and gambling with our lives. More thoughts below." / X After three years of pretraining research across OpenAI and Anthropic, a researcher stepped down while accu

My 70-year-old mum came over for a visit today, and she'd read some of the news stories about Anthropic researchers estimating that there's a 10% chance their AI systems will wipe out humanity by 2030

mastodon:hachydermother17d ago kagi ↗

My 70-year-old mum came over for a visit today, and she'd read some of the news stories about Anthropic researchers estimating that there's a 10% chance their AI systems will wipe out humanity by 2030. So she had some very concerned questions for her computer scientist son. They were: 1. "How do they come up with those percentages? Do they just make them up, or do you think they have their chatbot

AGI is coming and we are all going to die. Did your pulse go up? That is how AI marketing works now. An Anthropic researcher quit over exactly this. The fear is genuine. But nobody can compute 10%, an

mastodon:fosstodonother16d ago kagi ↗

AGI is coming and we are all going to die. Did your pulse go up? That is how AI marketing works now. An Anthropic researcher quit over exactly this. The fear is genuine. But nobody can compute 10%, and nobody can explain how recursive self-improvement would work. No known mechanism. Misalignment and criminal misuse have one. Those you can engineer against. https:// techcrunch.com/2026/09/09/gamb l

Anthropic researcher says humanity's future decided on 'MacBooks of engineers'

rss:toi-topinternational16d ago kagi ↗

Anthropic researcher Jacob Coxon has quit the AI industry, saying OpenAI and Anthropic are racing to self-improving superintelligence and gambling with our lives. His post, now past 155 million views, has pulled two more AI safety researchers out of Anthropic and Google and drawn a pacing plan from Anthropic CEO Dario Amodei, backed by Sam Altman and Elon Musk. Anthropic alignment lead Evan Hubing

The AI industry seems to be having its loudest debate yet about whether its technology poses an existential threat to humanity. The current discussion began after AI researcher Jacob Coxon said that h

mastodon:mstdn-socialother16d ago kagi ↗

The AI industry seems to be having its loudest debate yet about whether its technology poses an existential threat to humanity. The current discussion began after AI researcher Jacob Coxon said that he’s resigned from Anthropic because he’s worried that the leading AI companies are “gambling with our lives.” Then Anthropic’s alignment leaned chimed in […] https:// techcrunch.com/2026/09/13/what s-