NSFW AI Image Generation
The cluster discusses AI image generators producing pornographic or NSFW content due to training data contamination, challenges in implementing safeguards, ethical risks like CSAM and deepfakes, and companies' policies on censorship.
Activity Over Time
Top Contributors
Keywords
Sample Comments
Several of the image generators will create pornographic images due to their training data. This really isn't unexpected if the devs weren't careful with the generation service chosen?
You can’t use their generative AI tools on images it deems NSFW, even if the part you’re generating isn’t.
This shouldn't be flagged because this is a very interesting AI problem. Grok was trained on X content which contains a lot of porn. Other image generation models aren't trained on porn so they don't know how to produce it. It appears to be very difficult to stop Grok from making porn since it has been trained on it. Is the ony workable solution to not train Grok 5 on porn?
I'm guessing they're referring to the part in the article about paedophillic content - even if no real children are being harmed in the process (e.g. generating an image of an entirely new fictional child similar to thispersondoesnotexist.com and then run the output through the nude filter), it's still generating sexualised content depicting minors.
The original deepfakes were all porn. Current cutting edge image gen is all porn.
it seems like there's a lot of potential for abuse if you can get it to generate ai images of real people reliably.
How can ML models generate porn if they weren't trained on porn? It can't generate what it hasn't seen, right? So why are they training their models on porn?
Perhaps to provide negative samples so that it doesn’t generate porn-like imagery the rest of the time?
I thing they feed to many borderline NSFW picture material into the AI.
Eh, /r/stablediffusion has a bunch of top level posts showing pretty good output from the model.Maybe if you don’t care about making deepfake porn, it’s actually fine?(…and if for whatever reason you are you can still use all the other models they’ve released that support that and it’s really not a big deal… or wait for a fine tuned version /shrug)