Text to avoid paywall

The Food and Drug Administration is planning to use artificial intelligence to “radically increase efficiency” in deciding whether to approve new drugs and devices, one of several top priorities laid out in an article published Tuesday in JAMA.

Another initiative involves a review of chemicals and other “concerning ingredients” that appear in U.S. food but not in the food of other developed nations. And officials want to speed up the final stages of making a drug or medical device approval decision to mere weeks, citing the success of Operation Warp Speed during the Covid pandemic when workers raced to curb a spiraling death count.

“The F.D.A. will be focused on delivering faster cures and meaningful treatments for patients, especially those with neglected and rare diseases, healthier food for children and common-sense approaches to rebuild the public trust,” Dr. Marty Makary, the agency commissioner, and Dr. Vinay Prasad, who leads the division that oversees vaccines and gene therapy, wrote in the JAMA article.

The agency plays a central role in pursuing the agenda of the U.S. health secretary, Robert F. Kennedy Jr., and it has already begun to press food makers to eliminate artificial food dyes. The new road map also underscores the Trump administration’s efforts to smooth the way for major industries with an array of efforts aimed at getting products to pharmacies and store shelves quickly.

Some aspects of the proposals outlined in JAMA were met with skepticism, particularly the idea that artificial intelligence is up to the task of shearing months or years from the painstaking work of examining applications that companies submit when seeking approval for a drug or high-risk medical device.

“I don’t want to be dismissive of speeding reviews at the F.D.A.,” said Stephen Holland, a lawyer who formerly advised the House Committee on Energy and Commerce on health care. “I think that there is great potential here, but I’m not seeing the beef yet.”

    • buddascrayon@lemmy.world
      link
      fedilink
      English
      arrow-up
      5
      ·
      1 day ago

      Yeah I’m going to make sure I don’t take any new drugs for a few years. As it is I’m probably going to have to forgo vaccinations for a while because dipshit Kennedy has fucked with the vaccination board.

    • rottingleaf@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      arrow-down
      10
      ·
      1 day ago

      I’ll try arguing in the opposite direction for the sake of it:

      An “AI”, if not specifically tweaked, is just a bullshit machine approximating reality same way human-produced bullshit does.

      A human is a bullshit machine with an agenda.

      Depending on the cost of decisions made, an “AI”, if it’s trained on properly vetted data and not tweaked for an agenda, may be better than a human.

      If that cost is high enough, and so is the conflict of interest, a dice set might be better than a human.

      There are positions where any decision except a few is acceptable, yet malicious humans regularly pick one of those few.

      • Eximius@lemmy.world
        link
        fedilink
        English
        arrow-up
        11
        ·
        1 day ago

        Your argument becomes idiotic once you understand the actual technology. The AI bullshit machine’s agenda is “give nice answer” (“factual” is not an idea that has neural center in the AI brain), and “make reader happy”. The human “bullshit” machine, has many agendas, but it would have not got so far if it was spouting just happy bullshit (but I guess America is a becoming a very special case).

        • rottingleaf@lemmy.world
          link
          fedilink
          English
          arrow-up
          1
          arrow-down
          5
          ·
          1 day ago

          It doesn’t. I understand the actual technology. There are applications of human decision making where it’s possibly better.

          • Eximius@lemmy.world
            link
            fedilink
            English
            arrow-up
            8
            ·
            1 day ago

            LLM does no decision making. At all. It spouts (as you say) bullshit. If there is enough training data for “Trump is divine”, the LLM will predict that Trump is divine, with no second thought (no first thought either). And it’s not even great to use as a language-based database.

            Please don’t even consider LLMs as “AI”.

            • rottingleaf@lemmy.world
              link
              fedilink
              English
              arrow-up
              1
              arrow-down
              6
              ·
              1 day ago

              Even an RNG does decision-making.

              I know what LLMs are, thank you very much!

              If you wanted to even understand my initial point, you already would have.

              Things have become really grim if people who can’t read a small message are trying to teach me on fundamentals of LLMs.

              • Eximius@lemmy.world
                link
                fedilink
                English
                arrow-up
                6
                ·
                1 day ago

                I wouldn’t define flipping coins as decision making. Especially when it comes to blanket governmental policy that has the potential to kill (or severely disable) millions of people.

                You seem to not want any people to teach you anything. And are somehow completely dejected at such perceived actions.

                • rottingleaf@lemmy.world
                  link
                  fedilink
                  English
                  arrow-up
                  2
                  arrow-down
                  2
                  ·
                  1 day ago

                  You seem to not want any people to teach you anything.

                  No, I don’t seem that. I don’t like being ascribed opinions I haven’t expressed.

                  I wouldn’t define flipping coins as decision making. Especially when it comes to blanket governmental policy that has the potential to kill (or severely disable) millions of people.

                  When your goal is to avoid a certain most harmful subset of such decisions, and living humans always being pressured by power and corrupt profit to pick that subset, flipping coins is preferable, if that’s the two variants between which we are choosing.

    • gcheliotis@lemmy.world
      link
      fedilink
      English
      arrow-up
      7
      ·
      1 day ago

      Or maybe that is part of the allure of automation: the eschewing of human responsibility, such that any bias in decision making appears benign (the computer deemed it so, no one’s at fault) and any errors - if at all recognized as such - become simply a matter of bug-fixing or model fine-tuning. The more inscrutable the model the better in that sense. The computer becomes an oracle and no one’s to blame for its divinations.

      • AnarchistArtificer@lemmy.world
        cake
        link
        fedilink
        English
        arrow-up
        5
        ·
        1 day ago

        I saw a paper a while back that argued that AI is being used as “moral crumple zones”. For example, an AI used for health insurance acts allows for the company to reject medically necessary procedures without employees incurring as much moral injury as part of that (even low level customer service reps are likely to find comfort in being able to defer to the system.). It’s an interesting concept that I’ve thought about a lot since I found it.

        • gcheliotis@lemmy.world
          link
          fedilink
          English
          arrow-up
          1
          ·
          1 day ago

          I can absolutely see that. And I don’t think it’s AI-specific, it’s got to do with relegating responsibility to a machine. Of course AI in the guise of LLMs can make things worse with its low interpretability, where it might be even harder to trace anything back to an executive or clerical decision.

  • RememberTheApollo_@lemmy.world
    link
    fedilink
    English
    arrow-up
    9
    ·
    1 day ago

    Oh good, a 60% chance you’ll get an ineffective or killer drug because they’ll use AI to analyze the usage and AI to report on it.

    • ZILtoid1991@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      ·
      10 hours ago

      That is an underestimate, since it doesn’t factor in the knockdown effect of the more lax regulations having, so people will try to sell all kinds of crap as “medicine”.

    • 800XL@lemmy.world
      link
      fedilink
      English
      arrow-up
      5
      ·
      1 day ago

      If it actually ends up being an AI and not just some Trump cuck stooge masquerading as AI picking the drug by the company that gave the largest bribe to Trump, I 100% guarantee this AI is trained only on papers written by non-peer reviewed drug company paid “scientists” containing made up narratives.

      Those of us prescribed the drugs will be the guinea pigs because R&D costs money and hits the bottom line. The many deaths will be conveniently scape-goated on “the AI” the morons in charge promised is smarter and more efficient than a person.

      Fuck this shit.

  • cley_faye@lemmy.world
    link
    fedilink
    English
    arrow-up
    15
    ·
    1 day ago

    Things LLM can’t do well without extensive checking on large corpus of data:

    • summarizing
    • providing informed opinions

    What is it they want to make “more efficient” again? Digesting thousands of documents, filter extremely specific subset of data, and shorten the output?

    Oh.

  • postmateDumbass@lemmy.world
    cake
    link
    fedilink
    English
    arrow-up
    5
    ·
    1 day ago

    Final stage capitalism: Purging all the experts (at catching bullshit from appllicants) before the agencies train the AI with newb level inputs.

  • OCATMBBL@lemmy.world
    link
    fedilink
    English
    arrow-up
    23
    ·
    2 days ago

    So we’re going to depend on AI, which can’t reliably remember how many fingers humans have, to take over medical science roles. Neat!

    • 3abas@lemm.ee
      link
      fedilink
      English
      arrow-up
      3
      arrow-down
      10
      ·
      2 days ago

      Different types of AI, different training data, different expectations and outcomes. Generative AI is but one use case.

      It’s already been proven a useful tool in research, when directed and used correctly by an expert. It’s a tool, to give to scientists to assist them, not replace them.

      If you’re goal to use AI to replace people, you’ve got a bad surprise coming.

      If you’re not equipping your people with the skills and tools of AI, your people will become obsolete in short time.

      Learn AI and how to utilize it as a tool, you can train your own model on your own private data and locally interrogate the model to do unique analysis typically not possible in realtime. Learn the goods and bads of technology and let your ethics guide how you use it, but stop dismissing revolutionary technology because the earlier generative models weren’t reinforced enough get fingers right.

      • OCATMBBL@lemmy.world
        link
        fedilink
        English
        arrow-up
        3
        ·
        1 day ago

        I’m not dismissing its use. It is a useful tool, but it cannot replace experts at this point, or maybe ever (and I’m gathering you agree on this).

        If it ever does get to that point, we need to also remedy the massive social consequences of revoking those same experts’ ability to have sufficient income to have a reasonable living.

        I was being a little silly for effect.

  • ButtermilkBiscuit@feddit.nl
    link
    fedilink
    English
    arrow-up
    120
    ·
    2 days ago

    AI - famously known for being right all the time, and never making shit up. It’s so reliable we should let it approve drugs. Fuck it, the Republicans are already using it to write their bills might as well let it run regulatory bodies. /s

  • WindyRebel@lemmy.world
    link
    fedilink
    English
    arrow-up
    20
    ·
    2 days ago

    Efficiency =/= Accuracy or safety

    I can efficiently put a screw in drywall with an electric drill, but it doesn’t mean it will hold it up or attach it to anything.

    • Tryenjer@lemmy.world
      link
      fedilink
      English
      arrow-up
      6
      ·
      edit-2
      1 day ago

      Furthermore, something can be efficient in different ways depending on the criteria. Something can even be efficient in one context and inefficient in a different one. Efficiency as they use it is too vague.

  • Treczoks@lemmy.world
    link
    fedilink
    English
    arrow-up
    31
    arrow-down
    1
    ·
    2 days ago

    Oh my God. The reasons why I am happy not to be an American are stacking thicker every week.

  • iAvicenna@lemmy.world
    link
    fedilink
    English
    arrow-up
    20
    ·
    2 days ago

    I hope by AI they don’t mean LLMs because that is not the correct architecture for this job but definitely what every crook would go for to get funds.

  • Ledericas@lemm.ee
    link
    fedilink
    English
    arrow-up
    7
    ·
    2 days ago

    i think people will go over to canada, or even mexico for real drugs, no ones going to risk a “supplement” like industry.

  • untakenusername@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    10
    arrow-down
    2
    ·
    2 days ago

    ai has a place in drug development, but this is not how it should be used at all

    there should always be a reliable human system to double check the results of the model

    • fodor@lemmy.zip
      link
      fedilink
      English
      arrow-up
      6
      ·
      1 day ago

      I have to quibble with you, because you used the term “AI” instead of actually specifying what technology would make sense.

      As we have seen in the last 2 years, people who speak in general terms on this topic are almost always selling us snake oil. If they had a specific model or computer program that they thought was going to be useful because it fit a specific need in a certain way, they would have said that, but they didn’t.

      • untakenusername@sh.itjust.works
        link
        fedilink
        English
        arrow-up
        2
        ·
        1 day ago

        ik what you mean, there’s a difference between LLMs and other systems but its just generally easier to put it all under the umbrella of ‘AI’

  • floofloof@lemmy.ca
    link
    fedilink
    English
    arrow-up
    34
    ·
    edit-2
    1 day ago

    The same people who do everything they can to obstruct actual science, including research into vaccines and other medicines. ChatGPT can surely do what actual scientists and experienced health professionals can do. After all, ChatGPT can predict what word a person is likely to say next, so do a convincing impression of someone who knows about medicine. It’s probably no coincidence that many of these people are grifters in their own right, and those who aren’t are suckers for grifters. They have basic problems appreciating or caring about the difference between real and fake.