I’m interested in hosting something like this, and I’d like to know experiences regarding this topic.
The main reason to host this for privacy reasons and also to integrate my own PKM data (markdown files, mainly).
Feel free to recommend me videos, articles, other Lemmy communities, etc.
Mixtral is an amazing one that isn’t super slow or require incredible hardware foe a decent speed.
In general this guy has really good videos/tutorials for the latest tools.