With an iGPU results are going to be very slow. Most promising things I have heard of so far is Mixture of Experts type models, if you have an 8GB card you might be able to run Qwen 3.8-35B-A3B-MoE which I think is the most capable for that hardware.
There are websites that can suggest a few for your specific hardware, I assume some are vibecoded and are only occasionally updated to the latest models, so take it as you will. See this Lemming’s comment. And !localLLaMa@sh.itjust.works is where I think most of the discussion around new development with Local LLMs happens here on Lemmy.
Is there a local LLM I can run on an 8-10th gen i5 with 16GB RAM?
Yes, quite a few, but it depends on what you’re trying to do with them. Any ideas?
With an iGPU results are going to be very slow. Most promising things I have heard of so far is Mixture of Experts type models, if you have an 8GB card you might be able to run Qwen 3.8-35B-A3B-MoE which I think is the most capable for that hardware.
There are websites that can suggest a few for your specific hardware, I assume some are vibecoded and are only occasionally updated to the latest models, so take it as you will. See this Lemming’s comment. And !localLLaMa@sh.itjust.works is where I think most of the discussion around new development with Local LLMs happens here on Lemmy.
links