Ok, you have a moderately complex math problem you needed to solve. You gave the problem to 6 LLMS all paid versions. All 6 get the same numbers. Would you trust the answer?

  • zxqwas@lemmy.world
    link
    fedilink
    arrow-up
    8
    ·
    4 days ago

    Using a calculator or wolfram alpha or similar tools i don’t trust the answer unless it passes a few sanity checks. Frequently I am the source of error and no LLM can compensate for that.

      • pinball_wizard@lemmy.zip
        link
        fedilink
        arrow-up
        5
        ·
        edit-2
        4 days ago

        Yes. All six are likely to be incorrect.

        Similarly, you could ask a subtle quantum mechanics question to six psychologists, and all six may well give you the same answer. You still should not trust that answer.

        The way that LLMs correlate and gather answers is particularly unsuited to mathematics.

        Edit: I. Contrast, the average Psychologist is much more prepared to answer a quantum mechanics question, than an average LLM is to answer a math or counting question.

      • zxqwas@lemmy.world
        link
        fedilink
        arrow-up
        5
        ·
        4 days ago

        Don’t know. I’ve never asked any of them a maths question.

        How costly is it to be wrong? You seem to care enough to ask people on the Internet so it suggests that it’s fairly costly. I’d not trust them.