• db0@lemmy.dbzer0.comOP
    link
    fedilink
    English
    arrow-up
    64
    arrow-down
    2
    ·
    9 months ago

    “Hallucinate” is the standard term used to explain the GenAI models coming up with untrue statements

    • Cyrus Draegur@lemm.ee
      link
      fedilink
      English
      arrow-up
      22
      arrow-down
      1
      ·
      edit-2
      9 months ago

      in terms of communication utility, it’s also a very accurate term.

      when WE hallucinate, it’s because our internal predictive models are flying off the rails filling in the blanks based on assumptions rather than referencing concrete sensory information and generating results that conflict with reality.

      when AIs hallucinate, it’s due to its predictive model generating results that do not align with reality because it instead flew off the rails presuming what was calculated to be likely to exist rather than referencing positively certain information.

      it’s the same song, but played on a different instrument.

      • kronisk @lemmy.world
        link
        fedilink
        English
        arrow-up
        6
        arrow-down
        2
        ·
        9 months ago

        when WE hallucinate, it’s because our internal predictive models are flying off the rails filling in the blanks based on assumptions rather than referencing concrete sensory information and generating results that conflict with reality.

        Is it really? You make it sound like this is a proven fact.

        • KillingTimeItself@lemmy.dbzer0.com
          link
          fedilink
          English
          arrow-up
          1
          ·
          9 months ago

          i mean, idk about the assumptions part of it, but if you asked a psych or a philosopher, im sure they would agree.

          Or they would disagree and have about 3 pages worth of thoughts to immediately exclaim otherwise they would feel uneasy about their statement.

    • rottingleaf@lemmy.zip
      link
      fedilink
      English
      arrow-up
      5
      arrow-down
      16
      ·
      9 months ago

      They don’t come up with any statements, they generate data extrapolating other data.

        • SlopppyEngineer@lemmy.world
          link
          fedilink
          English
          arrow-up
          1
          ·
          9 months ago

          Main difference is that human brains usually try to verify their extrapolations. The good ones anyway. Although some end up in flat earth territory.

        • Prandom_returns@lemm.ee
          link
          fedilink
          English
          arrow-up
          2
          arrow-down
          12
          ·
          9 months ago

          Yes, my keyboard autofill is just like your brain, but I think it’s a bit “smarter” , as it doesn’t generate bad faith arguments.

          • NιƙƙιDιɱҽʂ@lemmy.world
            link
            fedilink
            English
            arrow-up
            4
            arrow-down
            2
            ·
            9 months ago

            Your Markov chain based keyboard prediction is a few tens of billions of parameters behind state of the art LLMs, but pop off queen…

            • Prandom_returns@lemm.ee
              link
              fedilink
              English
              arrow-up
              1
              arrow-down
              5
              ·
              9 months ago

              Thanks for the unprompted mansplanation bro, but I was specifically refering to the comment that replied “JuSt lIkE hUmAn BrAin”, to “they generate data based on other data”

              • NιƙƙιDιɱҽʂ@lemmy.world
                link
                fedilink
                English
                arrow-up
                2
                arrow-down
                1
                ·
                edit-2
                9 months ago

                That’s crazy, because they weren’t even talking about keyboard autofill, so why’d you even bring that up? How can you imply my comment is irrelevant when it’s a direct response to your initial irrelevant comment?

                Nice hijacking of the term mansplaining, btw. Super cool of you.

                • Prandom_returns@lemm.ee
                  link
                  fedilink
                  English
                  arrow-up
                  1
                  arrow-down
                  1
                  ·
                  9 months ago

                  Oh my god, we’ve got a sealion here.

                  Fine, I’ll play along, chew it up for you, since you’ve been so helpful and mansplained that a keyboard is different than LLM:

                  My comment was responding to anthropomorphization of software. Someone said it’s not human because it just generates output based on input. Someone else said “just like human brain”, I said yes, but also just like a keyboard, alluding to the false equivalence.

                  Clearer?