Which qwen for vllm?
Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.
Hugging face has over 300 versions of qwen3.8-27b. I have no idea how to identify the beat model to download and use.
Should I sort by “most likes” or “most downloads”? Is there any sort of other guidance on which model to select?
I’m finally getting my local linux box up and running and just realized that actually picking a model may be one of the most difficult choices I’ll have to make. I’m hoping someone here can shed some light on the subject.
Also, if you could, I’m looking for concepts more than “use this one” because it’s not just about qwen, but also other models now (gemma/etc.) and in the future and I’m hoping to learn how to pick what I need from the mess of options out there (sure glad we have all these options though!).
[link] [comments]
More from r/LocalLLaMA
-
The AI race: China's open-weight models trail US closed models by just 7 months
Oct 14
-
Anthropic Executive Says Open-Source AI Models Are Higher Risk
Oct 14
-
ComfyUI v0.40.0 released
Oct 14
-
So this is how they do it --> RTX 5090, once a consumer gaming card, is now on smugglers’ menu alongside cigarettes
Oct 14
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.