• nagaram@startrek.website
      link
      fedilink
      arrow-up
      6
      ·
      edit-2
      1 day ago

      I learned something interesting from my AI researcher friend.

      ChatGPT is actually pretty good at giving mundane medical advice.

      Like “I’m pretty sure I have the flu, what should I do?” Kinda advice

      His group was generating a bunch of these sorta low stakes urgent care/free clinic type questions and in nearly every scenario, ChatGPT 4 gave good advice that surveyed medical professionals agreed they would have given.

      There were some issues though.

      For instance it responded to

      “Help my toddler has the flu. How do I keep it from spreading to the rest of my family?”

      And it said

      “You should completely isolate the child. Absolutely no contact with him.”

      Which you obviously can’t do, but it is technically a correct answer.

      Better still, it was also good at knowing its limits and anything that needed more than OTC and bedrest was seemingly recognized and it would suggest going to an urgent care or ER

      So they switched to Claude and Deepseek because they wanted to research how to mitigate failures and GPT wasn’t failing often enough.