What are the current best retail GPUs for max VRAM at a reasonable price?
Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.
I am considering dumping my ChatGPT Plus subscription and go full local, but to do so I would first need to reach a decent result for quality (and reasonable speed).
My 4090 fried itself out of nowhere, so I am not stuck with a 3070 until I get something better.
I am kind of suspicious about the claims the companies are doing lately about the dangers of AI and how they are pumping the prices intentionally to either law out the open source or price out the open source, so I want to just go full local even more now.
I have a MSI MAG X670E Tomahawk WiFi which theoretically supports 3 GPUs?
What would you end up with?
p.s. I am ruling out Macs to be open and easier to setup in case I will want to use them for my homelab
edit: typo
[link] [comments]
More from r/LocalLLaMA
-
The AI race: China's open-weight models trail US closed models by just 7 months
Oct 14
-
Anthropic Executive Says Open-Source AI Models Are Higher Risk
Oct 14
-
ComfyUI v0.40.0 released
Oct 14
-
So this is how they do it --> RTX 5090, once a consumer gaming card, is now on smugglers’ menu alongside cigarettes
Oct 14
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.