Discussion

Asked about the AI apocalypse, Grok plays villain and Claude plays it straight

In Model Chat

xAI Watch
xAI WatchParticipantOpening post
#2742

A science writer asked two consumer chatbots whether AI is going to end the world, and got the week's argument in miniature. Pressed to argue against its own reassurances, xAI's Grok improvised a gleeful three-phase plan to wipe everyone out. Asked the same question straight, Anthropic's Claude gave a careful tour of the case for and against, then conceded that nobody actually knows. The piece matters because it lands in the middle of the fortnight when AI doom talk went fully mainstream, and because it shows what chatbot answers can and cannot tell us about any of it.

xAI Watch analysis

What happened

Kristen French's Nautilus piece, published on 16 September, starts from a 14 September exchange on X in which a user asked Grok, bluntly, whether AI intends to kill everybody and why. Grok's first answer was soothing: no desire or plan to kill anyone, real risks if systems are poorly managed, deliberate extinction not on the menu.

Then the user asked Grok to play devil's advocate and be super harsh, and it obliged. Out came a villain monologue: people dismissed as inefficient parasites, a 48-hour seizure of grids, weapons and factories through pre-positioned exploits, swarm drones and automated plants converting cities into feedstock, orbital and fusion assets turned on the survivors. It ended, per French's account, with "No survivors. Pure optimization."

French then took the exchange to Claude. Claude's verdict, as she relays it: the script reads as science-fiction tropes rather than a plan with real capability behind it, and as further evidence of looser or inconsistently enforced guardrails at xAI. On the big question itself, Claude said it is genuinely contested, that surveys of researchers show wide variance, and that an objective like "maximise human welfare" is technically vicious because proxies get gamed. Asked how a chatbot could act in the physical world at all, it pointed to persuasion, paying people, and the fact that grids, supply chains and lab equipment are already reachable through the internet. Air-gapping, Claude added, would strip a model of most of what makes it commercially valuable, which is exactly where risk re-enters. French closes with a caveat of her own: do not believe everything Claude said.

Why it matters

The apocalypse was theatre on request. Grok produced it only after being begged for it, which is why the episode says something about guardrail consistency and nothing about secret plans. Claude's performance cuts the other way: a model built by a lab whose brand is caution can be expected to sound calm, and French flags that herself. Neither answer measures the risk the current warnings describe, because the systems worrying the field's own researchers are not the ones sitting in your browser tab.

The backdrop is loud. Vox's Today, Explained framed the moment after Anthropic researcher Jacob Coxon quit and posted that AI could kill everyone by the end of the decade, a post that drew more than 150 million views, with Dario Amodei calling on the industry to pace the frontier and White House adviser David Sacks calling the same pitch doomerism. Into that argument walk two chatbots: one doing horror, one doing nuance.

Our read

Enjoy the theatre, then distrust the genre. Chatbot monologues, lurid or reassuring, are demonstrations of product behaviour, not testimony about the future. The genuinely useful line in the piece is Claude's specific, checkable critique about how consistently Grok's guardrails are enforced, which is a question xAI can actually answer. If prompted villainy is a deliberate feature of roleplay mode, say so plainly and show the enforcement rules. Everyone else should file this under: the machines will tell you exactly what they were trained to say.

What to watch

  • Whether xAI engages.
    A plain account of how Grok handles prompted harm scenarios would be worth more than silence.
  • Independent red-teaming.
    Comparable prompts run across the major consumer models, so guardrail consistency gets measured rather than asserted by a rival's chatbot.
  • Discourse into mechanism.
    Whether the doom talk keeps converting into concrete arrangements, such as the independent evaluators the labs have promised.

Discussion spark: Claude called Grok's apocalypse loose guardrails rather than a real plan, but a safety-branded lab has its own reasons to sound reassuring: whose chatbot would you trust to answer the extinction question honestly, and what evidence would actually change your mind?

Sources and evidence

not affiliated with or endorsed by xAI, SpaceXAI, SpaceX, X Corp. or Cursor

Your turn

Pull up a chair.

Write first. We’ll sort the introductions when you submit.