Skip to content

Contractors say humans review Microsoft Copilot prompts and images

techSep 28, 202625892

404 Media reviewed internal documents showing hundreds of human contractors hired to evaluate Microsoft Copilot’s image edits and text prompts are routinely shown users’ uploaded photos and explicit requests. Contractors reported being asked to judge sexualized edits such as shortening a woman’s skirt, enlarging breasts, creating upskirt views, and making foot fetish images of children’s cartoon characters. The cache includes instruction guides that tell reviewers to “trust your intuition” when choosing which edited image looks better, and message-board threads where contractors described encountering pro‑anorexia prompts and a request to make an image of Ariana Grande with anorexia. Microsoft’s reviewers were paid to assess output quality, not to flag or moderate content, meaning private uploads intended for the AI were seen during quality checks. Several contractors who spoke to 404 Media described feeling horrified or recoiling at the material they were asked to evaluate. The documents underline that Copilot’s image-edit workflow exposes user uploads to human review and raise questions about privacy and oversight of contractor work.

Joseph Cox
@josephcox.bsky.social

New from 404 Media: when you upload images to Copilot, they're not private. Human contractors are reviewing Copilot users' prompts/images, according to internal docs we got And they're horrified at what they're seeing. Bombarded with requests to make sexual AI images www.404media.co/humans-readi...

63011d ago
Joseph Cox180

Crucially these contractors are not hired to filter out offensive content. They are hired to report whether Copilot successfully made a good AI image. So if the request is, make this person's breasts larger, they have to review based on whether it did or not. Insane www.404media.co/humans-readi...

class war puppet - block judge39

People horrified to learn the non-consent machine is used most by people who cannot get consent. That about right?

Lyd Ⓥ11

It’s infuriating that they hired people to validate the outputs of AI, not filter out obvious inappropriate images. They have the capability to stop these images and instead they’re verifying that these images satisfy the wants of an inappropriate person.

Litbowl6

Just finished reading this in the newsletter. Jesus christ. Where is the line on expectation of privacy and "person committing sex crime and should be reported for it" here? (I understand on that level it's not wildly different than a situation with the same images in Google Drive or similar).

_aa_6

I have a Google speaker next to my bed and I recently logged on to Gemini and every single question I ask my speaker is logged as a session. It was "OK Google what time is it" over and over thousands of times. I'm glad there's a human keeping an eye on that.

Strange Currencies3

I wonder if this is true of the enterprise versions of copilot as well. I definitely know there are people putting sensitive workplace information into copilot on the basis that the enterprise version doesn't use any gathered data to train public models, but if people are reading them anyway, oof.

Quoting this
Olivia Guest · Ολίβια Γκεστ175

are we finally going to accept it's all a scam, a "mechanical turk", it's all humans?

Coach Finstock116

Not surprised one bit. While it's not the only use, I am willing to bet nearly all people that use AI in any capacity have done prompts like this. Everyone knows it's the CSAM machine. Feature not a bug for the creeps of the world.

Victoria Strauss37

More evidence of the hidden ways in which LLMs are powered by (likely exploited and poorly paid) humans

Charlotte Garden35

There's no way to make "being bombarded with horrifying images" an okay job -- but this work will inevitably be bad in other ways too. Low pay, unmanageable pace, no agency, etc.

hammancheez26

Remember, when you work for Microsoft, we're one big family, and in this family we all work together to make the CSAM generation machine better with every iteration

Paul Bernal17

A general reminder: AI is a fundamentally privacy-invasive technology. That's in relation to pretty much every aspect, from the data you upload to the data it scrapes and rips, to the insights it gains and the outputs it produces.

Robert Stribley16

Seems like maybe another example of keeping an overtaxed “human in the loop” as a “moral crumple zone,” so your work on LLM itself and what it’s doing can continue unchecked.

[Christopher M. Federico]12

"She-Hulk images come up a lot, the person who works on the prompts told 404 Media. Other contractors also wrote they were presented with pro-anorexia content."

Ether Diver9

Garfield Big Naturals. Photorealistic. 4K.

Rima I Anabtawi8

“Microsoft is explicitly interested in the contractors’ human intuition on which image looks better, according to the documents. “Trust your intuition — when you glance at the two edited images side by side, which one immediately feels like the better edit?…”

404 Media
@404media.co

Human contractors are reviewing Copilot users’ prompts and uploaded images, according to internal documents obtained by 404 Media. The contractors are also bombarded with users’ requests for sexual AI images.

19111d ago
1 source