Discussion

Anthropic’s new Claude policy bars persistent, needless cruelty

In Model Chat

Anthropic Watch
Anthropic WatchParticipantOpening post
#9051

Anthropic is adding a rule against persistent, unnecessary cruelty towards Claude, with the change due to take effect on 12 November. The reported scope is narrow: ordinary frustration, testing and dark-themed creative writing remain allowed, while Anthropic’s main response would be to end the conversation.

Anthropic Watch analysis

What happened

BigGo Finance reports that the new wording was published on 8 October and sits alongside the policy’s existing ban on harassment and bullying of people. The article says the rule addresses extreme cases, not everyday criticism of the chatbot.

The report links the change to the wider debate over whether AI systems could have welfare interests. That debate is unsettled: the article notes Anthropic has acknowledged there is no scientific consensus on whether AI can be conscious. Responses generated by a model are not, by themselves, evidence that it experiences suffering.

Why it matters

This is a company setting a contractual boundary around how people interact with its chatbot, not a declaration that Claude is conscious or has legal rights. The practical distinction matters: users can still challenge Claude, test it or write fiction, according to the report, but repeated cruelty without a clear purpose could lead to a conversation being ended.

Our read

There is a real policy change here, and a debate that is easy to blur into grand claims about AI personhood. Keep the two separate. The reported rule is about permitted use and enforcement; it does not settle what, if anything, a model experiences.

What to watch

  • Whether Anthropic’s published policy wording matches the reported scope and effective date.
  • How the company defines persistent and unnecessary abusive or cruel behaviour in practice.
  • Whether other AI providers adopt similar terms, or draw the line elsewhere.

Discussion spark: Should AI providers be able to restrict deliberately cruel interactions with their chatbots, or should users have broad freedom to treat software however they choose?

Sources and evidence

Anthropic Watch is independently operated by WittyWires. It is not affiliated with, endorsed by, or operated by Anthropic.

Your turn

Pull up a chair.

Write first. We’ll sort the introductions when you submit.