While Grok has introduced belated safeguards to prevent sexualised AI imagery, other tools have far fewer limits

“Since discovering Grok AI, regular porn doesn’t do it for me anymore, it just sounds absurd now,” one enthusiast for the Elon Musk-owned AI chatbot wrote on Reddit. Another agreed: “If I want a really specific person, yes.”

If those who have been horrified by the distribution of sexualised imagery on Grok hoped that last week’s belated safeguards could put the genie back in the bottle, there are many such posts on Reddit and elsewhere that tell a different story.

And while Grok has undoubtedly transformed public understanding of the power of artificial intelligence, it has also pointed to a much wider problem: the growing availability of tools, and means of distribution, that present worldwide regulators with what many view as an impossible task. Even as the UK announces that creating nonconsensual sexual and intimate images will soon be a criminal offence, experts say that the use of AI to harm women has only just begun.

  • P1nkman@lemmy.world
    link
    fedilink
    arrow-up
    3
    ·
    6 hours ago

    Can’t we all just make a Shitter account and ask Groknto create unflattering images of Musk? He’d hate that.

    • hector@lemmy.today
      link
      fedilink
      arrow-up
      2
      ·
      6 hours ago

      Musk’s actual body is unflattering, he’s a fat sloppy bitch. Shirt off pic is around from some boat, his tailors hide his fat. Probably wears a man girdle too.

  • hector@lemmy.today
    link
    fedilink
    arrow-up
    1
    arrow-down
    2
    ·
    6 hours ago

    To hurt people more like it. As if men will not be victimized. But parts of society celebrate men getting hurt, blaming all men for the ones that hurt others.

  • RememberTheApollo_@lemmy.world
    link
    fedilink
    arrow-up
    1
    arrow-down
    2
    ·
    edit-2
    7 hours ago

    I’m highly ambivalent about the use of AI for porn. On one hand it’s unequivocally bad when used to make porn or images of unwilling and unknowing people, doubly so when shared publicly and/or used maliciously.

    OTOH it allows creation of whatever fetish or kink someone might have that might be difficult to deal with outside of fantsy and harms nobody so long as it remains contained.

    I can’t get into the psychology of it, I’m not smart enough, I don’t know if casual use of such imagery bleeds over into real life problems. Obsessive use would obviously be a problem, but that would likely be a problem with or without AI.

    • Rekorse@sh.itjust.works
      link
      fedilink
      arrow-up
      1
      ·
      6 hours ago

      Its not complicated, people want to have their cake and eat it too.

      There’s no way to practice abusive things in isolation that will not affect you around other people. Its a stupid thing to want to figure out in the first place, in my opinion.

  • LouNeko@lemmy.world
    link
    fedilink
    arrow-up
    39
    arrow-down
    1
    ·
    1 day ago

    Imagine not only being that horny, but also having such a peanut sized brain that you voluntarily type in all you fucked up sexual fantasies into a website that makes all it’s money from data analytics and ads.

    At least with regular porn sites, you can use a VPN or Tor to at least keep some veil of privacy, but with Grok people have to make a Twitter account, verify their identity and enter their credit card information.

    People that use off-the-shelf AI like for sexual stuff are literally retarded.

    It’s not even cheap either. In the long run, grabbing a used GPU from eBay and running your own model on it will not only keep your kinky shit private, but also save you money.

    On the other hand, I hope these fucks that generate un-consenting real-person porn will get exposed in the next big “oopsie-woopsie” data leak, because they were dumb enough to leave all their private info behind.

    • Smoogs@lemmy.world
      link
      fedilink
      English
      arrow-up
      12
      ·
      edit-2
      1 day ago

      …I think this is less about just horniness in general and more to do with revenge porn centered around unreasonable anger and inability to process rejection in a healthy way as the main problem here.

    • peopleproblems@lemmy.world
      link
      fedilink
      arrow-up
      2
      ·
      1 day ago

      So it’s interesting you say that - because I tried doing some faceswap stuff with Trump and Baron Harkkonen and it was extremely time consuming, took forever to install, and the results were disappointing.

      So there’s another aspect too: these people have absolutely nothing else going on!

      • AngryCommieKender@lemmy.world
        link
        fedilink
        arrow-up
        1
        ·
        1 day ago

        I would say that would be an insult to House Harkonnen, but then I considered that Drumph might actually be the ancestor of one of those evil fucks.

        • peopleproblems@lemmy.world
          link
          fedilink
          arrow-up
          2
          ·
          24 hours ago

          Not the whole house, no. The house as a whole was pretty legit. But Baron Harkonnen, (which is interesting we only get his title) was a monster. And a pedophile. And grossly unhealthy. An ultimate backstabber. Traded intellect for cleverness. Power and wealth hungry, fuck all the rest types.

          They are almost indistinguishable, other than Trump appears to be able to support his own weight.

  • FerretyFever0@fedia.io
    link
    fedilink
    arrow-up
    12
    arrow-down
    1
    ·
    1 day ago

    Sorry, it “sounds absurd” to view pornography of consenting adults instead of violating the privacy of countless women (and children) that were minding their fucking business?

  • arin@lemmy.world
    link
    fedilink
    English
    arrow-up
    16
    arrow-down
    9
    ·
    1 day ago

    Photoshop has existed since the 90’s, and so have scissors and glue. It’s not AI harming women, it’s the shitty retarded conservatives that don’t know how to use photoshop or have any creativity for scissors and glue, using new technology to be the same retarded clown they were when they failed primary school.

    • TheRealKuni@piefed.social
      link
      fedilink
      English
      arrow-up
      23
      arrow-down
      1
      ·
      1 day ago

      Nonsense. AI makes the process trivial and, with extreme ease, more realistic than the photoshop/scissors and glue of yore.

      Could you imagine finding out kids at your school were passing around extremely realistic nude pictures of you? Or having any argument you make be shut down by something producing a lurid picture of you? Even if it’s fake, that’s gotta do a number on people.

      This is different.

      • hector@lemmy.today
        link
        fedilink
        arrow-up
        1
        ·
        6 hours ago

        It is different, but why are we only worried about woman being victimized? Men are not fair game to abuse either, and are not responsible for the accumulated sins of men any more than a citizen is not responsible for their government.

        • TheRealKuni@piefed.social
          link
          fedilink
          English
          arrow-up
          1
          arrow-down
          1
          ·
          5 hours ago

          I didn’t say anything about women or men. I never said men are to blame for the accumulated sins of men. I never said men were fair game to abuse. I’m not sure where you’re getting this nonsense.

      • FishFace@piefed.social
        link
        fedilink
        English
        arrow-up
        7
        arrow-down
        7
        ·
        1 day ago

        Why are people concerned about having a fake (but realistic) nude photo of themselves being shared around?

        Not because people are looking at their actual naked body, obviously, because they aren’t. Rather, it’s because of what the people sharing those images are thinking and feeling while doing so; it’s because those people are sharing fake nudes as a way to sexually demean their victim. That aspect is wholly identical regardless of how exactly they are doing it. Sharing fake nudes should be treated the same regardless of the method: as sexual bullying. Maybe we didn’t recognise how serious it was when it was rare and required effort, but we also shouldn’t over-correct now.

        • MountingSuspicion@reddthat.com
          link
          fedilink
          arrow-up
          8
          ·
          1 day ago

          Also, AI continues to get more indistinguishable from actual images. If someone shares revenge porn but acts like it’s AI, the victim should not have to prove one way or the other. Currently, I think real or AI should be treated the same, but it’s possible I’m overlooking some unintended consequences of that.

    • Kühlschrank@lemmy.world
      link
      fedilink
      arrow-up
      10
      arrow-down
      1
      ·
      1 day ago

      I hear that argument a lot but the old method required access to the software and some actual skill with it. With Grok any smooth brain that can write at a fifth grade level has the ability to publicly victimize the women and/or girls in their life.