Mistral modèles don’t have much filter don’t worry lmao
Mistral modèles don’t have much filter don’t worry lmao
They is no chance they are the one training it. It costs hundreds of millions to get a descent model. Seems like they will be using mistral, who have scrapped pretty much 100% of the web to use as training data.
Buying second hand 3090/7090xtx will be cheaper for better performances if you are not building the rest of the machine.
You are limited by bandwidth not compute with llm, so accelerator won’t change the interferance tp/s
I use similar feature on discord quite extensively (custom emote/sticker) and i don’t feel they are just a novelty. Allows us to have inside joke / custom reaction to specific event and I really miss it when trying out open source alternatives.
Too be fair to Gemini, even though it is worse than Claude and Gpt. The weird answer were caused by bad engineering and not by bad model training. They were forcing the incorporattion off the Google search results even though the base model would most likely have gotten it right.
You can take a look at exllama and llama.cpp source code on github if you want to see how it is implemented.
If you have good enough hardware, this is a rabbithole you could explore. https://github.com/oobabooga/text-generation-webui/
Around 48gb of VRAM if you want to run it in 4bits
To run this model locally at gpt4 writing speed you need at least 2 x 3090 or 2 x 7900xtx. VRAM is the limiting factor in 99% of cases for interference. You could try a smaller model like mistral-instruct or SOLAR with your hardware though.
I put zorin on my parent’s computer 2 years ago, while its a great distro, their windows app support is just marketing, its an out of date wine version with an unmaintained launcher. Worse than tinkering with wine yourself.
It does not work exactly like obsidian as it is an outliner. I use both on the same vault and logseq is slower on larger vault.
Do you use comfyui ?
Being able to run benchmarks doesn’t make it is a great experience to use unfortunately. 3/4 of applications don’t run or have bugs that the devs don’t want to fix.
Windows is not fine with ARM, which can be a turnoff for some.
Llama models tuned for conversation are pretty good at it. ChatGPT also was before getting nerfed a million time.
I think that for most people linux is the most simple OS to use, switched my parents and sister computer to Linux Mint and they don’t ask me to help them with windows changing their browser or moving their icons every two weeks. Though if you are trying to do anything more than web browsing, document editing and listening to music, you will have to learn how some of the os works.
Yes, but it will take some learning time
Llama 2 now uses a license that allows for commercial use.
Revolt tries to be a discord clone/replacement and suffer from some of the same issues. Matrix happens to have a lot of feature in common, but is focused on privacy and security at its core.