Michael Ten @lemmy.world to Technology@lemmy.worldEnglish · 7 months agoOpera is testing letting you download LLMs for local use, a first for a major browserwww.zdnet.comexternal-linkmessage-square29fedilinkarrow-up1126arrow-down119
arrow-up1107arrow-down1external-linkOpera is testing letting you download LLMs for local use, a first for a major browserwww.zdnet.comMichael Ten @lemmy.world to Technology@lemmy.worldEnglish · 7 months agomessage-square29fedilink
minus-squareBandicoot_Academic@lemmy.onelinkfedilinkEnglisharrow-up11·7 months agoIntresting. But I’m curious about the performance. A bigger LLM (mixtral) already struggles to run on my mid-range gaming PC. Trying to run an LLM that isn’t terrible on a standard laptop wouldn’t be a good experience.
Intresting. But I’m curious about the performance.
A bigger LLM (mixtral) already struggles to run on my mid-range gaming PC. Trying to run an LLM that isn’t terrible on a standard laptop wouldn’t be a good experience.