How are you running DeepSeekV4 flash or pro locally for non Mac users?
Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.
Seems all the mac users are having fun with ds4. For those of us on non metal platforms who are running this locally, how are you running it, CPU, CUDA, ROCm, others?
[link] [comments]
More from r/LocalLLaMA
-
What's in your RAG?
Jul 2
-
Palantir CEO rages against closed models
Jul 2
-
A cheap trick for reliable structured output: feed the validation error back into the retry
Jul 2
-
SenseNova-U1-8b-MoT-Infographic-V2 (released yesterday) - An open source SOTA beast for infographic design and image editing.
Jul 2
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.