Deepseek v3 how can I check on local computer?

Question

deepseek v3 how can I check on my local computer and is my hardware capable of running this model (64 GB RAM, and 4080 video card)

talldayo · Accepted Answer

Your computer can run it, but you have to layer the model across CPU and GPU memory. Your bottleneck will be PCIe speed, which probably won't be a huge issue for a 4080 on smaller quants.

dtnewman · Answer

Check out exo labs blog. https://blog.exolabs.net/day-2/

dcreater · Answer

Short answer: You cant run it locally. Its 670B parameters..Long(er) answer: check the reddit thread on r/LocalLLaMa

lavren1974 · Answer

Ollama doesn't have this model yet.