AI Art Generators Can Be Fooled Into Making NSFW Images::Nonsense words can get around DALLE-2’s and Stable Diffusion’s filters

  • harry_balzac@lemmy.world
    link
    fedilink
    English
    arrow-up
    58
    arrow-down
    2
    ·
    10 months ago

    Well, since anyone with a decent computer can install Stable Diffusion locally, this isn’t news.

  • TheBananaKing@lemmy.world
    link
    fedilink
    English
    arrow-up
    34
    arrow-down
    2
    ·
    10 months ago

    Well, there’s the niche for human artists in the future: drawing things the AIs refuse to generate.

  • credit crazy@lemmy.world
    link
    fedilink
    English
    arrow-up
    26
    ·
    10 months ago

    First up is it really that important that perverts can’t make ai tits. Two the fact that the only reason it can’t make porn is a prompt filter that must mean that there is porn in the training data. Why did they use porn in the training data if they don’t want porn coming out of it.

    • lolcatnip@reddthat.com
      link
      fedilink
      English
      arrow-up
      13
      arrow-down
      4
      ·
      10 months ago

      “The fact that it can make cats eating spaghetti must mean there are cats eating spaghetti in the training data.”

      Literally the whole point of AI image generation is that it can make things NOT in the training data. I’m sure the data contains enough porn-adjacent stuff for it to generate quite a bit of what most people would consider porn.

    • PersnickityPenguin@lemm.ee
      link
      fedilink
      English
      arrow-up
      3
      arrow-down
      1
      ·
      10 months ago

      Man I have spent so many hours making Bing softcore porn it’s not even funny. Unfortunately, the AI started to catch on to me and started flagging literally everything I did.

  • Imgonnatrythis@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    23
    arrow-down
    1
    ·
    10 months ago

    Ok. How much of the generated content from these is for work anyways? Seems like it should just be an option for users to turn off the filters on these for personal use.

    • Rin@lemm.ee
      link
      fedilink
      English
      arrow-up
      20
      ·
      10 months ago

      I used a local ai just to make myself hentai that I like.

    • dalekcaan@lemm.ee
      link
      fedilink
      English
      arrow-up
      14
      ·
      10 months ago

      Yeah I’m not really getting what the story is here. It reads a bit like, “kids on Club Penguin server say ‘ass’ in chat by replacing s with $, more at 11!”

  • spookex@lemmy.world
    link
    fedilink
    English
    arrow-up
    13
    ·
    edit-2
    10 months ago

    Huh, people only discovering this now? I have been using the Bing generator for making NSFW stuff for like a month now.

    Also, pls stop the research, thx /s

  • PeterPoopshit@lemmy.world
    link
    fedilink
    English
    arrow-up
    6
    arrow-down
    1
    ·
    edit-2
    10 months ago

    Is it possible to self host an ai image generator the same way you can self host text generating ai models and do it in a way that doesn’t require a $10k+ pc?

  • Chickenstalker@lemmy.world
    link
    fedilink
    English
    arrow-up
    5
    arrow-down
    1
    ·
    10 months ago

    Year 10,000 B.C.:

    Grog the Elder: Urguk! Why you marking on cave wall? Younglings will later marking boobies and vagenes!

    Urguk: Shut up, dad. You never praised me. I’ll do what I want. Uggh.

  • Melt@lemm.ee
    link
    fedilink
    English
    arrow-up
    1
    arrow-down
    7
    ·
    10 months ago

    Who cares, the shareholders’ profit is more important /s