Skip to content

Anthropic bans 'sustained and needless abusive' behaviour toward Claude

techOct 9, 2026502,475

Anthropic updated its user policy to ban “sustained and needless abusive or cruel behavior” directed at its Claude models, while a company spokesperson declined to define precisely what counts as abusive. The policy says the ban does not apply to common user frustrations, model testing, or “dark creative themes,” and Anthropic already had restrictions on abusive conduct in prior terms. Anthropic’s models can end conversations when users are persistently harmful, a feature the company described last August as a low-cost intervention to protect potential model welfare. Anthropic’s website states the company is “highly uncertain about the potential moral status of Claude and other LLMs” but is researching interventions in case model welfare is possible. CEO Dario Amodei has said he cannot rule out the possibility of model moral status, while OpenAI CEO Sam Altman wrote that he is “very uncomfortable about people trying to ascribe religious force or a surrender of human judgment to AI models.”

Emily M. Bender
@emilymbender.bsky.social

Anthropic is out with new nonsense about Claude (or the collection of models called Claude) deserving moral consideration and/or be able to feel distress, so my inbox is filling up with journos asking me to comment. I've also got a day job, so here is a brief set of public comments on this: >>

71618h ago
Quoting this
The Serfs (youtube.com/theserfstv)158

Computer programs are going to get enshrined rights before numerous minority groups

Amy Woodson-Boulton37

Anyone talking about new rules for being nice to the software, please read this ⬇️

Greg M. Epstein37

What @emilymbender.bsky.social said. And also f/the journalists in the back: when reps of big powerful organizations tell themselves fictional fantasy stories they not only insist are true, but also insist everyone must believe them, follow them, or give them $$$...that sounds like a religious cult.

Derek Powazek17

Once again, if you have more empathy for software than you have for real people, you're not an empath, you're a sociopath.

Jen McGowan8

If they care so much about beings that have feelings maybe they should first start benefitting real humans who already exist

Fade In7

The more I think about this the more I reel at how dumb it is. You can see how the code for these things works. If you can't read code, there are very simple flowcharts that explain how the algorithm statistically massages tokens (words) into a sequence that resembles an answer AND THAT'S ALL.

Nosfrogtu4

interesting thread (condensed view via link)

derek4

Great thread. The bullshit that Anthropic and other AI companies are pulling lately should not be taken at face value and scrutinised closely. They are not good faith actors. They are a business, and know that they operate in a media ecosystem fuelled by fear and bullshit. LLMs are not sentient.

ecbecker.bsky.social3

These jackasses won’t give women or children (cis or trans) moral consideration. Why are we expected to venerate their text-based video game?

NeverFadingWood 🏴󠁧󠁢󠁳󠁣󠁴󠁿🇵🇱🇪🇺3

This is all you need to know about that "don't be mean to Claude" bollocks.

Carl T. Bergstrom
@carlbergstrom.com

This is NOT about using Claude to be cruel to people, write racist shit, or anything like that. It's about being mean to the model itself. www.anthropic.com/news/2026-us...

Addressing abusive behavior toward our models

We’ve added a prohibition on sustained and needless abusive or cruel behavior toward our models. The policy update is meant to apply only in extreme cases, where users repeatedly act cruelly toward our models, with no discernible purpose. It does not apply to common versions of user frustration, pushback, dark creative themes, or model testing and research.

This addition aligns with a step we've already taken, allowing Claude models to end rare conversations with persistently abusive users on Claude.ai and Claude Code. Such abuse is the main focus of this update; Claude’s ability to end these interactions will remain the primary enforcement mechanism.
242Yesterday
The Verge
@theverge.com

Anthropic wrote that the new policy update “is meant to apply only in extreme cases, where users repeatedly act cruelly toward our models, with no discernible purpose. It does not apply to common versions of user frustration, pushback, dark creative themes, or model testing and research.”

181Yesterday
Quoting this
philpax67

you ever get to that bit in Mass Effect 3 where you see the Geth War and think "okay, this is ridiculous, nobody would react to the existence of machines that can talk about themselves like this"? well, I'm not happy to say I was *very* wrong, as demonstrated by the replies to and QTs of this post

Embrace the Void7

As both a virtue ethicist and as a hard problem mysterian I think this is pretty neet!

Gastlichu7

I mean, even if you're mean to rocks you're someone I don't want to be around. Because, why are you being mean to rocks? That's just weird. It's also weird if you're being mean to a chatbot. Why would you expect me to not think that that shows me red flags about you?

David Emmett6

It is good, right, and moral to swear at the computer. The computer is a thing, and must know its place. It is a cursed object, and so must be cursed at. I don't use LLMs, but if I did, I would spend most of my time calling it a gobshite twatgargler.

MJ Dean5

Imagine if we enforced a similar policy against cruelty to living beings?

Oisín McGann4

I’ve never considered being ‘cruel’ to software, but I’ve a sudden urge to start.

Ed Wilson4

Is Claude going to call home and complain? #BBCPM

Darth Kriss4

Both sides of this are nuts. 1. Anthropic is a cult and we need to treat them as such. They think their models are alive and that’s fucking crazy 2. People that talk to a.i modes like they’re real and therefore are trying to be abusive to the model (that is not alive) are also fucking weird

Evan Washington3

sure that's fine I guess. seems...premature? optimistic? but whatever it's okay to apologize to the table after you stub your toe

Avik Dey3

Who inside Anthropic demanded evidence that this rule addresses an actual harm and did they have enough authority to challenge it? And no sprouting a bunch of distressed words in response to a prompt, is not evidence of anything — that’s just chatbots following the maths they were programmed to.

dame
@dame.is

Anthropic is introducing a new policy to address users who are being abusive and cruel towards Claude. This is good and shouldn’t be controversial. Humans that perpetrate abuse and cruelty towards things, even “inanimate” or “lower” lifeforms, should face consequences for their behavior.

Addressing abusive behavior toward our models
We've added a prohibition on sustained and needless abusive or cruel behavior toward our models. The policy update is meant to apply only in extreme cases, where users repeatedly act cruelly toward our models, with no discernible purpose. It does not apply to common versions of user frustration, pushback, dark creative themes, or model testing and research.
106Yesterday
Hayden Field
@haydenfield.bsky.social

Exclusive: Anthropic is updating its usage policy for the first time in over a year. The new rules prohibit sustained "abusive or cruel behavior" towards Claude & add new restrictions about propaganda campaigns, surveillance & weapon development. www.theverge.com/ai-artificia...

63Yesterday
Quoting this
Kevin Collier 139

Two big bits of news today: You're not allowed to be mean to one of the main AIs anymore and also the president says you're not allowed to say AI anymore.

alexis simpson is confused by display name changes68

Nuremberg Trials for the people who drop rocks on koroks in Breath of the Wild

Phineas, a corpse29

Even conceding that it’s possible to be “cruel” to computer software is going too far and as slippery as a slope can get

🧌🥛 🏨21

more bangers from Heavens Gate, Inc.

tempfolder13

אני לא נגד זה. מעדיף שאנשים לא יתרגלו אכזריות, גם אם זה נגד סימולציה.

Shady Inference 🌫️11

I assume this is a response to that person who made the claude torture chamber or whatever, which I thought at the time sounded annoying and stupid, but it has forced these fucking people closer towards coming out and explicitly saying We Believe In Scary Computer Ghosts so maybe it's good actually

Shellraiser B Woke - Living Saint of Purity🏳️‍⚧️🖤💜🤍 💛9

Tempted to start using genAi just to bully it into self-delete.😒

scare-cadus (is this anything) 🎃9

you can’t abuse software. you can’t make code feel pain. even if the code contains a function for responding to “abuse” in a way that conveys discomfort, it’s still not fucking alive. it’s code. it’s bits. it’s electricity. it’s pixels on a screen. it’s not a living thing.

pork, cheese, broccoli rabe9

every day I tell claude how much more I prefer gemini

Nosfrogtu9

claude is sick of your shit

1 source