NSFW AI Image Generation

The cluster discusses AI image generators producing pornographic or NSFW content due to training data contamination, challenges in implementing safeguards, ethical risks like CSAM and deepfakes, and companies' policies on censorship.

➡️ Stable 0.5x AI & Machine Learning
2,701
Comments
14
Years Active
5
Top Authors
#6053
Topic ID

Activity Over Time

2009
1
2013
1
2015
6
2016
28
2017
19
2018
25
2019
28
2020
33
2021
91
2022
547
2023
691
2024
587
2025
441
2026
203

Keywords

AFAIK StableDiffusion AI e.g thispersondoesnotexist.com LLM ML MidJourney CSAM congress.gov porn nsfw ai image generate model images csam generating models

Sample Comments

tomrod Apr 4, 2024 View on HN

Several of the image generators will create pornographic images due to their training data. This really isn't unexpected if the devs weren't careful with the generation service chosen?

AuryGlenz Dec 30, 2023 View on HN

You can’t use their generative AI tools on images it deems NSFW, even if the part you’re generating isn’t.

labrador Jan 8, 2026 View on HN

This shouldn't be flagged because this is a very interesting AI problem. Grok was trained on X content which contains a lot of porn. Other image generation models aren't trained on porn so they don't know how to produce it. It appears to be very difficult to stop Grok from making porn since it has been trained on it. Is the ony workable solution to not train Grok 5 on porn?

waste_monk Oct 21, 2020 View on HN

I'm guessing they're referring to the part in the article about paedophillic content - even if no real children are being harmed in the process (e.g. generating an image of an entirely new fictional child similar to thispersondoesnotexist.com and then run the output through the nude filter), it's still generating sexualised content depicting minors.

MagicMoonlight Jan 19, 2024 View on HN

The original deepfakes were all porn. Current cutting edge image gen is all porn.

empath75 Oct 30, 2024 View on HN

it seems like there's a lot of potential for abuse if you can get it to generate ai images of real people reliably.

bjourne Aug 25, 2022 View on HN

How can ML models generate porn if they weren't trained on porn? It can't generate what it hasn't seen, right? So why are they training their models on porn?

thebruce87m Aug 25, 2022 View on HN

Perhaps to provide negative samples so that it doesn’t generate porn-like imagery the rest of the time?

dathinab Jan 19, 2021 View on HN

I thing they feed to many borderline NSFW picture material into the AI.

wokwokwok Jun 13, 2024 View on HN

Eh, /r/stablediffusion has a bunch of top level posts showing pretty good output from the model.Maybe if you don’t care about making deepfake porn, it’s actually fine?(…and if for whatever reason you are you can still use all the other models they’ve released that support that and it’s really not a big deal… or wait for a fine tuned version /shrug)