Ok, you have a moderately complex math problem you needed to solve. You gave the problem to 6 LLMS all paid versions. All 6 get the same numbers. Would you trust the answer?

    • pinball_wizard@lemmy.zip
      link
      fedilink
      arrow-up
      5
      ·
      edit-2
      4 days ago

      Yes. All six are likely to be incorrect.

      Similarly, you could ask a subtle quantum mechanics question to six psychologists, and all six may well give you the same answer. You still should not trust that answer.

      The way that LLMs correlate and gather answers is particularly unsuited to mathematics.

      Edit: I. Contrast, the average Psychologist is much more prepared to answer a quantum mechanics question, than an average LLM is to answer a math or counting question.

    • zxqwas@lemmy.world
      link
      fedilink
      arrow-up
      5
      ·
      4 days ago

      Don’t know. I’ve never asked any of them a maths question.

      How costly is it to be wrong? You seem to care enough to ask people on the Internet so it suggests that it’s fairly costly. I’d not trust them.