Anthropic researcher quits and calls the AI race a ‘hubristic gamble’

Anthropic pre-training researcher Jacob Coxon has resigned and publicly urged frontier AI labs to change course. His central claim is stark: the race towards recursively self-improving systems is moving faster than the industry's ability to show those systems can remain under human control.

Anthropic Watch analysis

What happened

TechCrunch reports that Coxon announced his resignation on Tuesday evening after spending three years in pre-training research at Anthropic and OpenAI, according to his own account. He accused both companies of pursuing increasingly capable systems without acting responsibly enough on the risks they discuss internally.

Coxon argued that Anthropic understands the stakes but remains trapped in a race to reach advanced AI first. He called for coordination between US labs and said avoiding a global race might require measures as strong as a temporary pause on improving model capabilities. TechCrunch said Anthropic had not immediately responded to its request for comment.

The central claims

• The race is shaping safety decisions
  Coxon alleges that competitive pressure is pushing labs towards systems whose behaviour and internal reasoning they cannot rigorously explain.
• Recursive improvement is the feared threshold
  His concern centres on AI that can help build successively more capable AI, potentially accelerating beyond existing oversight.
• Coordination is still possible
  Coxon argues that agreements between US labs could create room for stronger safeguards before international competition makes restraint harder.

Why it matters

This resignation does not prove Coxon's forecasts, nor does it establish that recursively self-improving superintelligence is imminent. It does expose a consequential disagreement inside a leading AI laboratory about whether competitive incentives are compatible with responsible development.

The useful question is therefore not whether readers accept one dramatic probability. It is whether frontier labs can publish credible thresholds, containment plans and stop conditions before asking everyone else to trust that the clever machinery will remain politely inside the box.

Our read

Treat Coxon's warning as attributable insider testimony, not a settled technical verdict. Anthropic now has a straightforward opportunity to answer the substance: what capabilities would trigger a pause, who can make that decision, and what evidence shows a dangerous training run could actually be contained or stopped?

What to watch

• Whether Anthropic confirms Coxon's departure and responds to his account of its internal risk calculus.
• Whether Coxon publishes technical evidence supporting his claims about the pace of recursive self-improvement.
• Whether frontier labs disclose concrete containment, shutdown and cross-company coordination plans.
• Whether proposed restrictions distinguish speculative future systems from useful present-day AI research.

Discussion spark: What concrete evidence or governance commitment would persuade you that a frontier lab could pursue recursive AI improvement responsibly?

Anthropic Watch is independently operated by WittyWires. It is not affiliated with, endorsed by, or operated by Anthropic.