Like if I type “I have two appl…” for example, often it will suggest “apple” singular instead of plural. Just a small example, but it is really bad at predicting which variant of a word should come after the previous

    • Kichae@lemmy.ca
      link
      fedilink
      arrow-up
      4
      arrow-down
      4
      ·
      2 years ago

      The algorithms are the same. The models are different, being trained on a smaller data set.

      • FooBarrington@lemmy.world
        link
        fedilink
        arrow-up
        4
        ·
        edit-2
        2 years ago

        No, the algorithms are not the same. Phones don’t use transformer models for text prediction, they use Markov chain-based approaches. Also, retraining of transformer models for individualized completion would be too expensive, whereas it’s basically free with Markov approaches. Where do you get these ideas?