Is there anyway to make it use less at it gets more advanced or will there be huge power plants just dedicated to AI all over the world soon?

  • vrighter@discuss.tchncs.de
    91·
    22 days ago

    imagine that to type one letter, you need to manually read all unicode code points several thousand times. When you’re done, you select one letter to type.

    Then you start rereading all unicode code points again for thousands of times again, for the next letter.

    That’s how llms work. When they say 175 billion parameters, it means at least that many calculations per token it generates