I want to add a second 7900XTX, question about pcie2/3/4
Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.
I've got a 7900XTX in my old gaming PC, now I want more vram and if I stay on one GPU I can only reasonably get 32GB and that just doesn't sound good enough. Using two slots, 48GB sounds way better and is much cheaper. I think 48GB is the minimum I want to have after going to any effort and expense.
But I hesitate about the second GPU because the motherboard is a b450 with pcie 3, but only pcie 2 for the second GPU. I don't know how much this would hurt. I can see a lot of b550 motherboards come with pcie 4 with pcie 3 on the second, I don't know if this is worth springing for. The CPU (5800X3D) only has 24 pcie lanes, I don't know if that is even relevant here. I don't know a lot of things.
I've read that tensor parallel isn't well supported anyway for these GPUs, so I guess I end up layer splitting anyway and I hope this means I don't have to worry about it at all. True? Or is pcie2 still gonna be a problem?
[link] [comments]
More from r/LocalLLaMA
-
Palantir CEO rages against closed models
Jul 2
-
SenseNova-U1-8b-MoT-Infographic-V2 (released yesterday) - An open source SOTA beast for infographic design and image editing.
Jul 2
-
[Benchmark] Kimi K2.7 Code Q3 on Mac Studio M3 Ultra + RTX PRO 6000 over llama.cpp RPC: prefill improves, no changes in token generation/decode
Jul 2
-
They fit! Mostly.... 2x 3090, Thermaltake Core p3
Jul 2
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.