Dual AMD Radeon AI Pro R9700 or dual NVIDIA or RTX 3090.
Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.
I’m building a dual GPU box. Originally the goal was 30b at FP8 or 70b at Q4. I planned to run two R9700’s, but I found a pair of NIB RTX 3090’s near me for $1600 each. Discount if I buy both. RTX 40/50 series are off the table. I would love an RTX PRO 6000, but that is also off the table.
I currently have a Studio M1 Max with 64GB RAM and an AM4 box with a 7900 XT that powers my Hermes agent. My goal is to cancel most of my frontier subscriptions and keep only one for coding.
[link] [comments]
More from r/LocalLLaMA
-
The AI race: China's open-weight models trail US closed models by just 7 months
Oct 14
-
Anthropic Executive Says Open-Source AI Models Are Higher Risk
Oct 14
-
ComfyUI v0.40.0 released
Oct 14
-
So this is how they do it --> RTX 5090, once a consumer gaming card, is now on smugglers’ menu alongside cigarettes
Oct 14
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.