Single 3090 Qwen 27B user, considering buying 128GB of RAM because of the hype
Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.
My current setup:
- single 3090 running turboderp/Qwen3.8-27B-exl3:SC_5.00bpw_H6_V6
- ~150k context, ~70t/s, unknown prefill because I didn't benchmark it (but it is ok)
- Intel 12400 CPU with 32GB DDR4 RAM
All the hype around strata makes me consider buying 128GB of 6000MHz DDR5 RAM and Ryzen 9700X just for it. I searched in this sub, but most posts about it is about prefill/token generation speed, not about output quality. I believe with 128GB RAM + 3090 I can run the IQ3 quant.
For those who have run both Qwen 3.8 27B and Qwen Next with strata, how would you compare these two, in particular about output accuracy? My main use case is coding and Hermes assistant.
BTW, are there other good options for a 128GB RAM + 3090 setup?
[link] [comments]
More from r/LocalLLaMA
-
The AI race: China's open-weight models trail US closed models by just 7 months
Oct 14
-
Anthropic Executive Says Open-Source AI Models Are Higher Risk
Oct 14
-
ComfyUI v0.40.0 released
Oct 14
-
So this is how they do it --> RTX 5090, once a consumer gaming card, is now on smugglers’ menu alongside cigarettes
Oct 14
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.