• HubertManne@piefed.social
    link
    fedilink
    English
    arrow-up
    49
    arrow-down
    2
    ·
    2 months ago

    I really don’t get it. These things are brand new. How can anyone get so into these things so quickly. I don’t take advice from people I barely know, much less ones that can be so easily and quickly reprogrammed.

    • kamenLady.@lemmy.world
      link
      fedilink
      English
      arrow-up
      28
      ·
      edit-2
      2 months ago

      This is the unintentional uncanny valley for me in AI.

      I ( was forced to ) use chatGTP for work. It can talk about everything and sounds very confident and seems reliable to always come up with something to help you solve your problems.

      You talk with it about some niche content and suddenly have an ardent fan of said niche content responding. It surely knows every little bit of info of that niche and surprises you with funny, but apt quotes from your favorite show in the middle of conversations about something else.

      This is just from a tiny bit of interaction, while at work.

      I can imagine people completely overwhelmed, by having their thoughts confirmed and supported by something that seems so intelligent, responsive and remembers all your conversations. It literally remembers each word.

      For many people it may be the first time in their life, that they experience a positive response to their thoughts. Not only that, they also found someone eager to talk with them about it.

      • HubertManne@piefed.social
        link
        fedilink
        English
        arrow-up
        30
        ·
        2 months ago

        Everyones initial use of chatbots should be on the thing they are most knowledgable about so they can get an idea of how wrong it can be and how it can be useful but you have to treat it like some eager wet behind the ears intern just did for you.

    • FishFace@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      ·
      2 months ago

      Because that’s what it is really trained for: to produce correct grammar and plausible sentences. It’s really an unbelievable leap from computer-generated text from preceding approaches where, in a matter of a few years, you went from little more than gibberish to stuff that’s so incredibly realistic that it can be mistaken for intelligent conversation, easily passing the Turing Test (I had to actually go to Wikipedia to check and, indeed, this was verified this year - note that this in particular is for recent models)

      So you have something that is sufficiently realistic that it can appear to be a human conversation partner. Human beings aren’t (yet) well-equipped to deal with something which appears to be human but whose behaviour diverges from typical human behaviour so radically (most relevantly, it won’t readily admit to not knowing something).

      • HubertManne@piefed.social
        link
        fedilink
        English
        arrow-up
        1
        ·
        2 months ago

        Its more than that. It takes the input and tries to interpret the bad grammar and sentences into search terms and finds link the correlate the highest to its interpretation and then gives back the response that summarizes the results with good grammar and plausible sentences. Again this is why I stress that you have to evaluate its response and sources. The sources are the real value in any query. Im actually not sure how much the chatbots give sources by default though as I know I have not gotten them and then asked for them and now I get them as a matter of course so im not sure if it learns that I want them or if they did a change to provide them when they had not before.