Tech experts are starting to doubt that ChatGPT and A.I. ‘hallucinations’ will ever go away: ‘This isn’t fixable’::Experts are starting to doubt it, and even OpenAI CEO Sam Altman is a bit stumped.

  • Serdan@lemm.ee
    link
    fedilink
    English
    arrow-up
    4
    arrow-down
    8
    ·
    edit-2
    1 year ago

    GPT can write and edit code that works. It simply can’t be true that it’s solely doing language patterns with no semantic understanding.

    To fix your analogy: the Spanish speaker will happily sing along. They may notice the occasional odd turn of phrase, but the song as a whole is perfectly understandable.

    Edit: GPT can literally write songs that make sense. Even in Spanish. A metaphor aiming to elucidate a deficiency probably shouldn’t use an example that the system is actually quite proficient at.

    • Dark Arc@lemmy.world
      link
      fedilink
      English
      arrow-up
      6
      arrow-down
      1
      ·
      1 year ago

      Sure it can, “print hello world in C++”

      #include 
      
      int main() {
        std::cout << "hello world\n";
        return 0;
      }
      

      “print d ft just rd go t in C++”

      #include 
      
      int main() {
        std::cout << "d ft just rd go t\n";
        return 0;
      }
      

      The latter is a “novel program” it’s never seen before, but it’s possible because it’s seen a pattern of “print X” and the X goes over here. That doesn’t mean it understands what it just did, it’s just got millions (?) of patterns it’s been trained on.