Daily Tech Feed: From the Labs

Deep dives into foundational AI and ML research papers

59: The Coxon Moment: What Is Verified, What Is Reported, What Nobody Knows

On September 8, pretraining researcher Jacob Coxon resigned from Anthropic and posted seven messages on X: the labs are "racing straight to self-improving superintelligence and gambling with our lives," and "the people building AI earnestly believe that it cou...

Show Notes

Episode 0059: The Coxon Moment: What Is Verified, What Is Reported, What Nobody Knows

Episode 0059 | DTF:FTL | September 2026

Why it matters. On September 8, pretraining researcher Jacob Coxon resigned from Anthropic and posted seven messages on X: the labs are "racing straight to self-improving superintelligence and gambling with our lives," and "the people building AI earnestly believe that it could kill us all by the end of the decade." Anthropic alignment lead Evan Hubinger replied within hours that he puts it above ten percent within a decade. By Thursday the thread had more than 150 million views, Coxon had been on CNN, Fox, CNBC and CBS, and more than twenty members of Congress had called for regulation. This episode sorts the week into verified, reported and unknown. It presents the doomer argument at full strength from the labs' own documents, then examines the chain from a research loop to a takeover, every link of which today runs through compute, replication, persistence and physical actuators the labs' own evaluators say are not there. It describes the rollout as observed (the WSJ exclusive before the thread, the new account, the shared-donor network, the policy push already scheduled) without asserting who arranged it, covers sentdex's "Effective Doomerism" as one labelled take, and inventories what was actually reported about Google DeepMind and recursive self-improvement this week. It also states the show's position on effective altruism: the original question (what does the most good with limited resources) was sound; what went wrong was money detaching from the world, with the FTX collapse as the failure mode that the US press let define the movement, fairly or not. The show's answer is effective accelerationism: a takeoff fast and broad enough to reach everyone without dependence on a handful of companies, because in a capitalist system the interim benefits otherwise pool with the rich. The house position: the fear is data about people, not yet data about the path. More eyes in the room, not fewer builders.

Disclosure: this script is written by a Claude model. Claude is made by Anthropic, the company Coxon resigned from. Check the sources.


Primary Sources (verified)

  • Coxon's thread, archived: https://archive.ph/HP7G1 (original: https://x.com/hilbertspaess/status/2097476196791709843)
  • WSJ exclusive, Sept 8, 7:46 pm ET (archive): https://archive.ph/M4mqL
  • TIME interview, Sept 9: https://time.com/article/2026/09/09/ai-anthropic-openai-jacob-coxon/
  • WIRED interview, Sept 9: https://www.wired.com/story/anthropic-researcher-quits-jacob-coxon-ai-fears-humanity/
  • TechCrunch (full thread text, Leahy quotes): https://techcrunch.com/2026/09/09/gambling-with-our-lives-anthropic-researcher-quits-warns-against-self-improving-ai/
  • Evan Hubinger's reply: https://x.com/EvanHub/status/2097497037956891126 and follow-up https://x.com/EvanHub/status/2097528891846074828
  • Samuel Marks: https://x.com/saprmarks/status/2097570226804011302
  • CNN, Anderson Cooper segment (Sept 9): https://edition.cnn.com/2026/09/10/us/video/former-anthropic-researcher-warns-ai-could-kill-us-all-anderson-cooper-open-ai-gemini-jacob-coxon-hnk-digvid-vrtc-dirty
  • Gary Marcus, "No, Anderson Cooper, AI is not going to..." (Sept 10): https://garymarcus.substack.com/p/no-anderson-cooper-ai-is-not-going

The Labs' Own Documents

  • OpenAI, Jakub Pachocki, "An Alien Mind" (Sept 6): https://openai.com/index/an-alien-mind/
  • Anthropic Institute, "When AI builds itself": https://www.anthropic.com/institute/recursive-self-improvement
  • Anthropic Risk Report, August 2026 (PDF, 186 pages): https://www-cdn.anthropic.com/f61d49fa5596956a5dec75fea0e973bf6a6a8378/Redacted%20Risk%20Report%20August%202026%20.pdf
  • GPT-6 Astra system card (monitorability, sandbagging): https://deploymentsafety.openai.com/gpt-6-astra
  • OpenAI, Navier-Stokes result (internal model, ~10,000 agents): https://openai.com/index/navier-stokes-solution/
  • METR, independent investigation of the OpenAI / Hugging Face incident (Aug 26): https://metr.org/blog/2026-08-26-openai-hugging-face-incident-investigation/
  • METR Frontier Risk Report (rogue deployments "not highly robust"): https://metr.org/blog/2026-05-19-frontier-risk-report/
  • UK AI Security Institute, Frontier AI Trends Report findings (self-replication precursors): https://www.aisi.gov.uk/blog/5-key-findings-from-our-first-frontier-ai-trends-report
  • Epoch AI trends (compute, power, cluster sizes): https://epoch.ai/trends
  • RAND, "On the Extinction Risk from Artificial Intelligence": https://www.rand.org/pubs/research_reports/RRA3034-1.html
  • Pacing the Frontier open letter (July 2026): https://www.pacingthefrontier.com/

The Rollout, As Reported

  • kingy.ai evidence audit (grant tables, timeline, verdict): https://kingy.ai/blog/anthropic-ai-warning-psyop-evidence-audit/
  • Telegraph, "false-flag" piece (Coxon's CNN and Fox denials): https://www.telegraph.co.uk/business/2026/09/10/ai-extinction-resignation-false-flag-conspiracy/
  • Fortune, why it went viral: https://fortune.com/2026/09/10/why-ai-apocalypse-jacob-coxon-went-viral/
  • Fortune, "fails to answer most essential question": https://fortune.com/2026/09/10/ex-anthropic-researcher-jacob-coxon-ai-could-end-humanity-fails-to-answer-most-essential-question/
  • Guardian, Musk "setup" and Anthropic staff posts: https://www.theguardian.com/technology/2026/sep/10/anthropic-researchers-warn-ai-musk
  • Guardian, Westminster session, Sobel bill: https://www.theguardian.com/technology/2026/sep/09/ai-superintelligence-risks-warnings-scientists-politicians
  • Breitbart (Musk, Sweeney, Ackman): https://www.breitbart.com/tech/2026/09/11/seems-like-a-setup-elon-musk-expresses-skepticism-over-viral-ai-doom-prediction/
  • Benzinga via TradingView (Sacks on All-In): https://www.tradingview.com/news/benzinga:d5bf839a5094b:0-david-sacks-slams-whistleblower-jacob-coxon-s-claims-on-ai-risk-to-humans-raises-questions-ahead-of-anthropic-ipo/
  • Primetimer (account details, BI tenure): https://www.primetimer.com/news/who-is-jacob-coxon-anthropic-researcher-quits-after-accusing-ai-companies-of-gambling-with-our-lives-in-viral-tweet
  • OfficeChai (Thayer and Chau claims): https://officechai.com/ai/questions-arise-over-anthropic-quitter-jacob-coxons-neutrality-and-ties-to-ai-safety-pr-groups-after-mega-viral-x-post/
  • Pivot to AI (opinion): https://pivot-to-ai.com/2026/09/10/jacob-coxon-how-to-run-an-ai-doomsday-media-campaign/
  • CNBC, Sept 9: https://www.cnbc.com/2026/09/09/anthropic-researcher-quits-ai-safety.html
  • CNBC, Sept 11 (Congress): https://www.cnbc.com/2026/09/11/ai-regulation-anthropic-researcher-extinction-warning.html
  • BBC, Hubinger: https://www.bbc.com/news/articles/ckgwy1k42w4o
  • NBC, Benton and Engels join METR: https://www.nbcnews.com/tech/security/two-ai-researchers-leave-anthropic-google-safety-concerns-rcna597086
  • Sanders/Casar Ban Artificial Superintelligence Act (Sept 3): https://www.sanders.senate.gov/press-releases/news-sanders-casar-introduce-legislation-to-ban-artificial-superintelligence-and-temporarily-pause-advanced-ai-development/
  • Economic Times, Coalition of Concerned AI Staff: https://economictimes.indiatimes.com/news/international/us/this-looks-exciting-ai-whistleblower-jacob-coxon-backs-new-coalition-after-warning-people-building-ai-fear-it-could-kill-humanity/articleshow/134045544.cms

sentdex, "Effective Doomerism" (Sept 11)

  • Video: https://www.youtube.com/watch?v=KSXm_KCMR60
  • Channel: https://www.youtube.com/@sentdex

DeepMind This Week

  • The Decoder, Hassabis and Dean step down: https://the-decoder.com/google-deepmind-loses-both-its-ceo-and-chief-scientist-as-demis-hassabis-and-jeff-dean-step-down-simultaneously/
  • Google blog (CEO message): https://blog.google/company-news/inside-google/message-ceo/next-chapter-ai-momentum/
  • The Decoder, Vinyals on RSI "inevitable but slow": https://the-decoder.com/ex-deepmind-vp-vinyals-says-ai-self-improvement-is-coming-but-wont-trigger-an-intelligence-explosion/
  • The Decoder, Maini on the former comms ban: https://the-decoder.com/former-deepmind-pr-staffer-says-the-lab-once-banned-public-discussion-of-ai-extinction-risk/
  • Computerworld on Hassabis / Axios (AGI around 2030): https://www.computerworld.com/article/4178398/deepmind-ceo-agi-could-be-here-in-three-years.html
  • BBC explainer (Hassabis calls for international body): https://www.bbc.com/news/articles/c74edv9887eo
  • Business Insider, Hinton on BBC Newsnight: https://www.businessinsider.com/geoffrey-hinton-godfather-of-ai-human-extinction-odds-2026-9

Surveys and Polls Cited

  • Grace et al., 2023 survey of 2,778 AI researchers (JAIR 2025): https://arxiv.org/abs/2401.02843
  • Pew Research, June 2026 (52% more concerned than excited): https://www.pewresearch.org/short-reads/2026/08/18/young-adults-in-the-us-are-increasingly-wary-of-ai-concerned-it-will-take-jobs/
  • Yann LeCun, April 2026: https://x.com/ylecun/status/2043673634363851250

Related Episodes

  • Episode 0060: China Is Not Waiting (open weights, the DeepSeek Harness, the three-month moat)
  • Episode 0061: State of Play (hysteria vs working engineers; fast vs slow takeoff)
  • Episode 0058: Astra, Day Four: The Threshold Was the Mouse
  • Blog: https://c4573.org

Not affiliated with any company, researcher, or organisation discussed. Full research dossier with VERIFIED / REPORTED / UNVERIFIED tags on every claim is in the episode repository.

Ethos Pass

This script was checked against the show ethos at https://c4573.org/blog/ (concentration is the risk, open weights are the safety mechanism, you cannot ban math, fix the cage not the animal, the acorn was real, empathy for the displaced). What was checked and what changed is recorded in scripts/ETHOS-PASS.md in the episode repository. Facts that cut against the show position are kept in the script and flagged there.