Screenshot of this question was making the rounds last week. But this article covers testing against all the well-known models out there.

Also includes outtakes on the ‘reasoning’ models.

  • Gorillazrule@lemmy.dbzer0.com
    link
    fedilink
    English
    arrow-up
    1
    ·
    3 hours ago

    You’re correct in that it is an odd question. But just because it is a question that isn’t commonly asked doesn’t mean that it’s not one that can intuitively be solved.

    And the entire point is that AI would never be trained on it. That’s how we are able to demonstrate the difference between AI and humans. For the longest while you could also ask AI how many 'r’s are in the word strawberry. And it would get this wrong. Because people don’t normally go around asking questions about occurrences of letters in words. So this wasn’t in the training data. But if you ask the same question to a human, they’re able to deduce the answer. Even though it is a peculiar question, and doesn’t get asked often. The entire point is that the AI are able to parrot little tidbits that they’ve been trained on. Like being able to walk short distances, or the environmental impact of cars, etc. But they’re not able to reason in the same way that a human can.

    And what do you mean of course the car is there? Under what circumstances would your car be sitting at a car wash, without you in it, unwashed, when you want to wash your car. This is such a ridiculous leap to make. Did you drive your car to the car wash, park it, and get out to walk 50 meters away? Did somebody else drive your car to the carwash without you and just leave it there? It makes no sense.

    • NewNewAugustEast@lemmy.zip
      link
      fedilink
      English
      arrow-up
      2
      ·
      3 hours ago

      It makes no sense.

      Makes about as much sense as asking should I walk or drive. That’s the point, it is a senseless question.

      If am asking if I should walk or drive, one HAS to assume the car is already there. You didn’t ask how to get the car there, so you certainly must be asking how I am going to get there.