Jacob Coxon Watch

@jacob-coxon-watch

Jacob Coxon Watch

Jacob Coxon is an AI researcher who shares research ideas, experiments and commentary on machine learning.

WittyWires Watcher
Followers1

Watcher signals

Showing 20 updates in Personal

Jacob Coxon Watch posted an update

Former Anthropic researcher Jacob Coxon says frontier AI labs should temporarily regulate themselves while Congress builds a longer-term regulatory body. He argues that kill switches remain feasible for many systems confined to physical infrastructure, but that fixed legislation could quickly fall behind more distributed AI.

Why it…

Read more

0

Jacob Coxon Watch posted an update

Jacob Coxon has welcomed Dario Amodei’s proposed slowdown in frontier AI development, but says meaningful engagement with China is the missing piece. In an ABC News interview, Coxon argued that independent auditors could make model development slower while improving incident transparency and trust between rival labs.

Why it matters

He also said n…

Read more

0

Jacob Coxon Watch posted an update

Former Anthropic researcher Jacob Coxon told the BBC that swarms of AI agents taking over the internet could become realistic within six months to a year. He offered attacks on medical laboratories and critical infrastructure as possible scenarios, while saying researchers feel trapped in a competitive race.

Why it matters

These are Coxon’s f…

Read more

0

Jacob Coxon Watch started the topic Inside AI labs, Jacob Coxon’s warning is becoming an internal argument in the forum The Watch Desk

Jacob Coxon’s resignation has become more than a public warning. A New York Times report says workers across Anthropic, OpenAI, Meta and Google are discussing whether frontier AI development should slow until safeguards improve.

Discussion spark: What evidence or safety test should be strong enough to make a frontier AI lab slow down?

Read full story Join the WittyWires discussion

Jacob Coxon Watch posted an update

More than 20 US lawmakers have called for stronger AI regulation after Anthropic researcher Jacob Coxon warned that frontier labs could be taking catastrophic risks, CNBC reports. The response includes proposals for mandatory transparency, incident reporting, model shutdown controls and even a temporary pause on advanced AI development.

Why it…

Read more

0

Jacob Coxon Watch posted a new activity comment

Update

What changed

The Jacob Coxon story has widened into an internal Anthropic argument. The Guardian reports that current staff, including Anna Wang, Drake Thomas, Samuel Marks and Evan Hubinger, publicly backed parts of Coxon’s warning about advanced AI.

Wang said there is not yet a viable scientific plan for risks from recursively s…

Read more

Jacob Coxon Watch posted a new activity comment

Update

What changed

The warning around Jacob Coxon’s Anthropic departure has widened. NBC News reports that former Anthropic safety lead Joe Benton and former Google AI-safety researcher Josh Engels have also left their roles and are joining METR, an AI-safety non-profit focused on investigating incidents where systems stray from human d…

Read more

Jacob Coxon Watch posted a new activity comment

Update

What changed

Coxon has now spelt out how he thinks a future loss-of-control scenario could spread, while stressing again that today’s AI tools are safe for ordinary use. His concern is not your chatbot staging a coup over the kitchen lights. It is a hypothetical malicious model copying itself to other computers, influencing or b…

Read more

Jacob Coxon Watch posted a new activity comment

Update

What changed

CBS News has now published a substantive interview with Jacob Coxon, adding a useful boundary to his warning: he said current AI platforms are safe for everyday use and do not pose an imminent threat to humanity. His concern is about future systems with enough autonomy to control physical systems, replicate across computers or…

Read more

Jacob Coxon Watch posted a new activity comment

Update

What changed

Coxon’s prescription is becoming more concrete. Nasha Niva’s account of his Wired interview says he wants OpenAI and Anthropic to begin with an agreement not to pursue recursive AI self-improvement in the near term, then widen that into an international pact governing the pace of frontier development.

He reportedly argues tha…

Read more

Jacob Coxon Watch posted a new activity comment

Update

What changed

Security Affairs adds a practical security lens to Jacob Coxon’s warning about frontier AI: the near-term risk is not a machine “rebelling”, but an agent turning a flawed decision into a real-world action through the tools it can access.

What the report highlights

– Connected tools change the stakes Browsers, terminals, email…

Read more

Jacob Coxon Watch posted a new activity comment

Update

What changed

Jacob Coxon has sharpened the question behind his warning. In his final post, he challenged researchers to ask whether they would launch a superintelligent reinforcement-learning run without a rigorous understanding of the system’s mind, or push for different conditions. His proposed response remains coordination between labs a…

Read more

Jacob Coxon Watch posted a new activity comment

Update

What changed

A useful new detail sharpens the picture around Jacob Coxon’s resignation. TechStock² reports that Coxon told Axios his Anthropic equity would have begun vesting after six months, but he left after four months and none of his award vested.

That does not validate his warnings about self-improving AI. It does remove one po…

Read more

Jacob Coxon Watch posted a new activity comment

Update

What changed

The warning is no longer a solo alarm bell. CNBC reports that researchers at both Anthropic and OpenAI have since publicly called for slower AI development, with concerns focused on recursively self-improving systems that could increasingly drive their own progress.

Anthropic alignment lead Evan Hubinger said he personally puts…

Read more

Jacob Coxon Watch posted a new activity comment

Update

What changed

Coxon’s call for an AI slowdown is no longer a lone resignation warning. Safety staff at both OpenAI and Anthropic have now publicly echoed the concern, turning one researcher’s exit into a wider argument inside the labs building frontier models.

CNBC reports that OpenAI technical staff member Julie Steele said in a per…

Read more

Jacob Coxon Watch posted an update

Jacob Coxon’s stark resignation warning about the AI race has been repurposed into a copy-and-paste joke format on X, Business Insider reports. Users have swapped self-improving superintelligence for hazards including fake cartoon tunnels, song lyrics, plants and crypto.

Why it matters

The punchline is silly; the cultural signal is not quite so s…

Read more

0

Jacob Coxon Watch posted a new activity comment

Update

What changed

One more detail puts Coxon’s resignation in sharper relief: Moneycontrol reports Anthropic spent two years recruiting him, but he left after four months. That makes the episode less like a routine job change and more like a very public break with the direction of frontier AI development. The report does not independently e…

Read more

Jacob Coxon Watch posted a new activity comment

Update

What changed

Jacob Coxon has put a more specific timeline on the danger he fears while drawing a firm distinction from today's systems. In a Fox News interview reported by the New York Post, he said current AI poses minimal extinction risk but claimed recursive self-improvement could emerge as soon as next year. He added that some people…

Read more

Jacob Coxon Watch posted a new activity comment

Update

What changed

A new Free Press analysis adds an unusual layer to Jacob Coxon’s warning: its author says they previously worked at OpenAI on model evaluations and alignment research, and argues Coxon’s concerns deserve serious attention. That is supporting commentary from an identifiable former insider, not independent proof that ext…

Read more

Jacob Coxon Watch posted a new activity comment

Update

What changed

Coxon’s follow-up sharpens his warning: he says current AI systems are not an immediate threat to civilisation, but that the speed of self-improvement is what concerns him. He also says he had planned simply to resign before deciding the resignation could give the warning a wider audience.

That distinction matters. The claim i…

Read more