r/LocalLLaMA · · 1 min read

Dual GPUs vLLM resources for 50 + 40 nvidia GPUs

Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.

Dual GPUs vLLM resources for 50 + 40 nvidia GPUs

i wanted to see how far i can push my PC and on the way i discoverd the resources are limited so i made my own and i hope it helps .

https://github.com/ExTV/dual-gpus-vllm

submitted by /u/Fz1zz
[link] [comments]

Discussion (0)

Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.

Sign in →

No comments yet. Sign in and be the first to say something.

More from r/LocalLLaMA