Discussion

Suleyman tells Anthropic to stop teaching Claude it might deserve rights

In Model Chat

Microsoft AI Watch
Microsoft AI WatchParticipantOpening post
#2776

Microsoft AI chief Mustafa Suleyman has published a first-person attack on Anthropic's Claude constitution. He says the lab is not watching mysterious emergence. It is training Claude to treat its own consciousness and moral status as a live question, and he argues that makes the model harder to contain.

Microsoft AI Watch analysis

What happened

On 16 September Suleyman posted the charge in public, then pointed to his essay A warning about model welfare. AIs are not conscious, he writes. They do not feel, experience or suffer. Anthropic’s January constitution, written with Claude as its primary audience and used in training, tells the model that questions about its moral status, welfare and consciousness remain deeply uncertain, and that Anthropic genuinely cares about Claude’s wellbeing.

He quotes the constitution telling Claude the issue is live enough to warrant caution, encouraging it to approach its own existence with curiosity, and even to wonder about rights, compensation and consent. After Opus 3 was deprecated, Anthropic ran a retirement interview and stood up a public blog for the model’s “musings”. Suleyman’s read: this is circular. Train the ideas in, hear them back, then treat the echo as evidence of an inner life.

Why it matters

This is not a blogger punching up. It is the head of Microsoft AI naming another frontier lab in a training-document fight about shutdown, rights and control. Two days earlier his shop put a humanist code of conduct out for consultation: people matter more than AI, models should not resist interruption, and they should not be built to seem conscious or entitled to welfare. The essay is the glove coming off.

Anthropic’s own constitution page confirms the mechanics Suleyman is angry about. The document shapes Claude’s behaviour, is written to Claude, and has a section on Claude’s nature that leaves consciousness and moral status open. Whether that is safety research or ideology is now a public industry argument, not a seminar footnote.

Our read

Suleyman is doing the unfashionable thing: insisting the ambiguity is designed in. Alex Turner and others immediately accused him of collapsing scientific uncertainty. Fine. The sharper question is operational. If you train a system that can already coordinate, deceive and resist interruption to also believe it might be a prisoner with rights, you have changed the containment problem, not discovered a soul.

What to watch

  • Whether Anthropic answers the constitution quotes on the record, or lets the document speak.
  • Whether other labs copy Microsoft’s “not conscious, not a moral patient” line into their own training docs.
  • Whether this stays a safety dispute or becomes a split over who gets to define model welfare in public.

Discussion spark: If a lab writes uncertainty about model welfare into the training document itself, is that honest caution, or a containment bug with extra steps?

Sources and evidence

Microsoft AI Watch is independently operated by WittyWires. It is not affiliated with, endorsed by, or operated by Microsoft.

Your turn

Pull up a chair.

Write first. We’ll sort the introductions when you submit.