n7gifmdn@lemmy.ca to Memes@lemmy.mlEnglish · 7 months agoMeta AIimage.nostr.buildimagemessage-square19fedilinkarrow-up1983arrow-down110
arrow-up1973arrow-down1imageMeta AIimage.nostr.buildn7gifmdn@lemmy.ca to Memes@lemmy.mlEnglish · 7 months agomessage-square19fedilink
minus-squarem-p{3}@lemmy.calinkfedilinkarrow-up50arrow-down4·edit-27 months agoThe quantized model you can run locally works decently and they can’t read any of it, which is nice. I use that one specifically https://huggingface.co/lmstudio-community/Meta-Llama-3-8B-Instruct-GGUF/blob/main/Meta-Llama-3-8B-Instruct-Q4_K_M.gguf If you’re looking for a relatively user-friendly software to use it, you can look at GPT4All (open source) or LM Studio.
minus-squarenialv7@lemmy.worldlinkfedilinkarrow-up11·7 months agoPretty sure LM studio is not open source
minus-squarem-p{3}@lemmy.calinkfedilinkarrow-up6·7 months agoYou’re right, I thought they were but I checked their GitHub and LM Studio itself isn’t.
The quantized model you can run locally works decently and they can’t read any of it, which is nice.
I use that one specifically https://huggingface.co/lmstudio-community/Meta-Llama-3-8B-Instruct-GGUF/blob/main/Meta-Llama-3-8B-Instruct-Q4_K_M.gguf
If you’re looking for a relatively user-friendly software to use it, you can look at GPT4All (open source) or LM Studio.
Pretty sure LM studio is not open source
You’re right, I thought they were but I checked their GitHub and LM Studio itself isn’t.