r/LocalLLaMA · · 1 min read

Petition to add a rule for people to add their DAMN quant levels to their posts

Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.

Every time I see a post about a newly released model, whether it be a comparison or shitting on it, I have to dig through the endless comments to see what quants they used and what their specs were.

Its quite a common occurrence here in this sub to ask someone that's saying a model is underperforming, and when you ask what quantization they are running they say something like "oh im running q0.1bpw from nobodyknowswhothisguyis".

Worst offender is with comparison posts. "Comparing the new Qwen3.8-27B to Qwen3.5-9B and the 9B model is better!" I wonder why?

Sorry for bad england

submitted by /u/Su1tz
[link] [comments]

Discussion (0)

Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.

Sign in →

No comments yet. Sign in and be the first to say something.

More from r/LocalLLaMA