A mother and her 14-year-old daughter are advocating for better protections for victims after AI-generated nude images of the teen and other female classmates were circulated at a high school in New Jersey.

Meanwhile, on the other side of the country, officials are investigating an incident involving a teenage boy who allegedly used artificial intelligence to create and distribute similar images of other students – also teen girls - that attend a high school in suburban Seattle, Washington.

The disturbing cases have put a spotlight yet again on explicit AI-generated material that overwhelmingly harms women and children and is booming online at an unprecedented rate. According to an analysis by independent researcher Genevieve Oh that was shared with The Associated Press, more than 143,000 new deepfake videos were posted online this year, which surpasses every other year combined.

  • Treczoks@lemm.ee
    link
    fedilink
    arrow-up
    20
    arrow-down
    3
    ·
    11 months ago

    The problem is how to actually prevent this. What could one do? Make AI systems illegal? Make graphics tools illegal? Make the Internet illegal? Make computers illegal?

      • Treczoks@lemm.ee
        link
        fedilink
        arrow-up
        16
        arrow-down
        2
        ·
        11 months ago

        Isn’t it already? Has it provided any sort of protection? Many things in this world are illegal, and nobody cares.

        • Jimmyeatsausage@lemmy.world
          link
          fedilink
          arrow-up
          9
          arrow-down
          5
          ·
          11 months ago

          Yes, I would argue that if CSAM was legal, there would be more of it…meaning it being illegal provides a level of protection.

          • yamanii@lemmy.world
            link
            fedilink
            arrow-up
            6
            arrow-down
            1
            ·
            11 months ago

            I wonder why are you being downvoted, something being illegal puts fear in most people to not do it.

            • 31337@sh.itjust.works
              link
              fedilink
              arrow-up
              1
              ·
              11 months ago

              I’ve been wondering about this lately, but I’m not sure how much of an effect this has. There are millions of people in prison, and many of those will go on to offend again. Making things illegal can be seen as an agreement to a social contract (in a democracy), drive the activity underground (probably good thing in many cases), and prevent businesses (legal entities) from engaging in the activity; but I’m not sure how well it works on an individual level of deterrence. Like, if there were no laws, I can not really think of a law I would break that I wouldn’t already break regardless. I guess I’d just be more open about it.

              Though, people who cause harm to others should be removed from society, and ideally, quickly rehabilitated, and released back into society as a productive member.

      • CAVOK@lemmy.world
        link
        fedilink
        arrow-up
        10
        arrow-down
        2
        ·
        edit-2
        11 months ago

        It is where I’m at. Draw Lisa Simpson nude and you get a visit from the law. Dunno what the punishment is though. A fine? Jail? Can’t say.

        Edit: Apparently I was wrong, it has to be a realistic drawing. See here: 2010/0064/COD doc.nr 10335/1/10 REV 1

        • Rodeo@lemmy.ca
          link
          fedilink
          arrow-up
          6
          arrow-down
          4
          ·
          11 months ago

          What about making depictions of other crimes? Should depictions of theft be illegal? Depictions of murder?

          Why should depictions of one crime be made illegal, but depictions of other heinous crimes remain legal?

          • Jimmyeatsausage@lemmy.world
            link
            fedilink
            arrow-up
            7
            arrow-down
            2
            ·
            11 months ago

            Because a picture of someone robbing my house doesn’t revictimize me. Even if it’s simulated, every time they run into some rando who recognizes them or every time a potential employer runs a background/social media check, it impacts the victim again

            • Rodeo@lemmy.ca
              link
              fedilink
              arrow-up
              4
              arrow-down
              2
              ·
              edit-2
              11 months ago

              Who is being victimized with a drawing of Lisa Simpson?

    • afraid_of_zombies@lemmy.world
      link
      fedilink
      arrow-up
      10
      arrow-down
      11
      ·
      11 months ago

      Require consent to take a person’s picture and hold them liable for whatever comes from them putting it on a computer.

      • jimbo@lemmy.world
        link
        fedilink
        arrow-up
        6
        arrow-down
        2
        ·
        11 months ago

        That’s a whole fucking can of worms we don’t need to open. Just make faking porn a crime similar to publishing revenge porn.

        • afraid_of_zombies@lemmy.world
          link
          fedilink
          arrow-up
          4
          arrow-down
          1
          ·
          11 months ago

          Nah. Use my image and pay me what I want. If I can’t make a Mickey Mouse movie they shouldn’t be able to make a porn staring me. Does a corporatation have more rights to an image than I have to my image?

          • jimbo@lemmy.world
            link
            fedilink
            arrow-up
            1
            ·
            edit-2
            11 months ago

            That really depends on what you consider “using my image”. Are you going to demand that people pay you because you were wandering around in the background of their family photo or their YouTube video? Will you ask to be compensated when people post group photos that include you on their social media? Does mom owe you money for all those pictures she took of you as a kid?

      • Treczoks@lemm.ee
        link
        fedilink
        arrow-up
        6
        arrow-down
        18
        ·
        11 months ago

        You already need consent to take a persons picture. Did it help in this case? I don’t think so.

          • Treczoks@lemm.ee
            link
            fedilink
            arrow-up
            4
            arrow-down
            3
            ·
            11 months ago

            Sorry, I forgot that the US is decades behind the rest of the world in privacy laws.

            Well, maybe you could start with this aspect.

        • afraid_of_zombies@lemmy.world
          link
          fedilink
          arrow-up
          3
          arrow-down
          8
          ·
          11 months ago

          Really? Please show me the signed and notarized letter with the girl’s name on it that says they agree to have their image used for AI porn. Also since she is a minor her legal guardians.

          • CommanderCloon@lemmy.ml
            link
            fedilink
            arrow-up
            6
            arrow-down
            1
            ·
            11 months ago

            How would you possibly enforce that, or prevent people from just copying publicly available pictures for nefarious usage

            • afraid_of_zombies@lemmy.world
              link
              fedilink
              arrow-up
              2
              arrow-down
              4
              ·
              11 months ago

              It would have to be enforced after getting caught. As an add on charge. Like if an area has a rule against picking locks to commit a crime. You can never be charged with it alone but you can add that on to existing charges.