now i gotta download something i don’t even wanna download.
Yup. Downloaded 7b, 32b, and 70b varieties this afternoon. Entirely out of spite.
Since those smaller models are technically fine-tunes of Meta/Facebook’s LLAMA, using Deepseek’s outputs, I wonder if they would be covered by the bill at all.
I literally just did the same
Fascist regime and power/police abuse has started.
P.S.: It seems like the US is becoming similar to Russia, kleptocratic country and organised crime in government.
to be fair for black Americans that is a centuries old tune
Oh, you’re right
Don’t worry, their already bad situation will get worse too.
Every step unchallenged is an invitation to do more.
For Base Model
git lfs install git clone https://huggingface.co/deepseek-ai/DeepSeek-V3-Base
For Chat Model
git lfs install git clone https://huggingface.co/deepseek-ai/DeepSeek-V3
this is deepseek-v3. deepseek-r1 is the model that got all the media hype: https://huggingface.co/deepseek-ai/DeepSeek-R1
Can you elaborate on the differences?
Base models are general purpose language models, mainly useful for AI researchers and people who want to build on top of them.
Instruct or chat models are chatbots. They are made by fine-tuning base models.
The V3 models linked by OP are Deepseek’s non-reasoning models, similar to Claude or ChatGPT4o. These are the “normal” chatbots that reply with whatever comes to their mind. Deepseek also has a reasoning model, R1. Such models take time to “think” before supplying their final answer; they tend to give better performance for stuff like math problems, at the cost of being slower to get the answer.
It should be mentioned that you probably won’t be able to run these models yourself unless you have a data center style rig with 4-5 GPUs. The Deepseek V3 and R1 models are chonky beasts. There are smaller “distilled” forms of R1 that are possible to run locally, though.
I heard people saying they could run the r1 32B model on moderate gaming hardware albeit slowly
32b is still distilled. The full one is 671b.
I know, but the fall off in performance isn’t supposed to be severe
You are correct. And yes that is kinda the whole point of the distilled models.
I know. Lmao
My legion slim 5 14" can run it not too bad.
https://www.deepseekv3.com/en/download
I was assuming one was pre-trained and one wasn’t but don’t think that’s correct and don’t care enough to investigate further.
Is that website legit? I’ve only ever seen https://www.deepseek.com/
And I would personally recommend downloading from HuggingFace or Ollama
r1 is lightweight and optimized for local environments on a home PC. It’s supposed to be pretty good at programming and logic and kinda awkward at conversation.
v3 is powerful and meant to run on cloud servers. It’s supposed to make for some pretty convincing conversations.
R1 isn’t really runnable with a home rig. You might be able to run a distilled version of the model though!
Tell that to my home rig currently running the 671b model…
That likely is one of the distilled versions I’m talking about. R1 is 720 GB, and wouldn’t even fit into memory on a normal computer. Heck, even the 1.58-bit quant is 131GB, which is outside the range of a normal desktop PC.
But I’m sure you know what version you’re running better than I do, so I’m not going to bother guessing.
It’s not. I can run the 2.51bit quant
You must have a lot of memory, sounds like a lot of fun!
You’re absolutely right, I wasn’t trying to get that in-depth, which is why I said “lightweight and optimized,” instead of “when using a distilled version” because that raises more questions than it answers. But I probably overgeneralized by making it a blanket statement like that.
Hawley’s statement called DeepSeek “a data-harvesting, low-cost AI model that sparked international concern and sent American technology stocks plummeting.”
data-harvesting
???
It runs offline… using open-source software that provably does not collect or transmit any data…
It is low-cost and out-competes American technology, though, true
sent American technology stocks plummeting
Oh yeah, thats what did it, totally
You don’t fuck with the big man money tbh… That’s like rule 1 of the game.
I’m gonna download it even harder.
See you hell evildoer!
This is astounding.
I mean, not the Deepseek or jailing stuff. I mean a Senator actually proposing a law. I thought the way our government worked was, the annoying orange declares a vague uncited threat to be bad, and signs an executive order on it!
No, we also allow mega corporations to submit bills that get rubber stamped by a rep somewhere. I don’t think a corporation would be so audacious as to submit this, so it’s a rare case of original content.
That’s awesome! I didn’t know you could download an LLM and run it locally! That’s what I’m really interested in is something that’s on my side and not a conduit to Google, MS or other.
I’m so glad Hawley proposed this bill or I wouldn’t have known that deepseek was open source and downloadable! I’ll have to go look for a download.
Ollama makes it pretty easy, and there are other runners as well. Good luck!
AFAICT it’s not open source, just open weights.
Download the model and run locally is the most secure and privacy friendly way to use it.
It’s absurd how little they know about what they are doing.
And that’s exactly why they want to stop it
Nah, Congress (esp the Senate) is a bunch of old people yelling at clouds, and sometimes they yell the same thing. Don’t give them too much credit.
deleted by creator
I doubt they understand local vs server distinction.
“Server is when we ask Amazon to build a backdoor, local is when we ask Microsoft”
It’s easy to run a distilled version of the R1 model locally. It’s very difficult to run the full version. Min $6k to get 7 tokens per second.
Here’s one for 2k if you don’t mine jank (edit: and 3-4 tokens :) )
https://digitalspaceport.com/how-to-run-deepseek-r1-671b-fully-locally-on-2000-epyc-rig/
I hear its easy, but I’ve had no luck at all on the most distilled models (for prelim testing), and am wondering how things have broken so badly.
I wasn’t thinking of downloading an AI onto my low tier computer until now.
I’ve got a laptop kicking around from 2010 that’s about to get deepseek just because they’re proposing this dumb ass shit. I don’t even use Gen AI.
Finally affordable housing!
same lmao
Land of the free
Yes the ban on TikTok is working! We’re getting more and more freer!!! The kids will be saved!!! \s \s \s
“Victory for free speech (as long as it means only we get to talk”)! /s
I wasn’t gonna, but now I gotta…
You laugh, but stay safe
God, I hate Hawley. He’s an embarrassment to my state.
He doesn’t even live in Missouri.
So I guess it’s free speech as long as you agree with the goverment’s speech. If not, then it’s a crime.
Elon Musk was just posting a factory of prisoners all working for cents on the dollar saying that America needs more of that.
Always have been, and this is a bipartisan value, heck, it’s common to all political parties of the world.
Yeah that’s called being a sovereign… They will respect each other doing since it is a club in a oligarchy or “democracy” but little people need watch that mother fucking mouth, or daddy gonna issue some backhand
free speech is when racial slurs obviously
