NSFW AI Image Generation

The cluster discusses AI image generators producing pornographic or NSFW content due to training data contamination, challenges in implementing safeguards, ethical risks like CSAM and deepfakes, and companies' policies on censorship.

➡️ Stable 0.5x AI & Machine Learning
2,701
Comments
14
Years Active
5
Top Authors
#6053
Topic ID

Activity Over Time

2009
1
2013
1
2015
6
2016
28
2017
19
2018
25
2019
28
2020
33
2021
91
2022
547
2023
691
2024
587
2025
441
2026
203

Keywords

AFAIK StableDiffusion AI e.g thispersondoesnotexist.com LLM ML MidJourney CSAM congress.gov porn nsfw ai image generate model images csam generating models

Sample Comments

tomrod • Apr 4, 2024 • View on HN

Several of the image generators will create pornographic images due to their training data. This really isn't unexpected if the devs weren't careful with the generation service chosen?

AuryGlenz • Dec 30, 2023 • View on HN

You can’t use their generative AI tools on images it deems NSFW, even if the part you’re generating isn’t.

labrador • Jan 8, 2026 • View on HN

This shouldn't be flagged because this is a very interesting AI problem. Grok was trained on X content which contains a lot of porn. Other image generation models aren't trained on porn so they don't know how to produce it. It appears to be very difficult to stop Grok from making porn since it has been trained on it. Is the ony workable solution to not train Grok 5 on porn?

waste_monk • Oct 21, 2020 • View on HN

I'm guessing they're referring to the part in the article about paedophillic content - even if no real children are being harmed in the process (e.g. generating an image of an entirely new fictional child similar to thispersondoesnotexist.com and then run the output through the nude filter), it's still generating sexualised content depicting minors.

MagicMoonlight • Jan 19, 2024 • View on HN

The original deepfakes were all porn. Current cutting edge image gen is all porn.

empath75 • Oct 30, 2024 • View on HN

it seems like there's a lot of potential for abuse if you can get it to generate ai images of real people reliably.

bjourne • Aug 25, 2022 • View on HN

How can ML models generate porn if they weren't trained on porn? It can't generate what it hasn't seen, right? So why are they training their models on porn?

thebruce87m • Aug 25, 2022 • View on HN

Perhaps to provide negative samples so that it doesn’t generate porn-like imagery the rest of the time?

dathinab • Jan 19, 2021 • View on HN

I thing they feed to many borderline NSFW picture material into the AI.

wokwokwok • Jun 13, 2024 • View on HN

Eh, /r/stablediffusion has a bunch of top level posts showing pretty good output from the model.Maybe if you don’t care about making deepfake porn, it’s actually fine?(…and if for whatever reason you are you can still use all the other models they’ve released that support that and it’s really not a big deal… or wait for a fine tuned version /shrug)