Is there some KDL chart for MiMo-V2.5 or something regarding the quants quality?
Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.
I'm using the model with opencode and the issue is it's looping hard when reasoning. It's not a deranged babbling though, the reasoning is legit large spans of text, it just can't get outside of the loop and make a decision. So I babysit it, stop and direct it to the right path, and it mostly does okay and finishes the job even with the loop remains sitting there in the context.
So, yea, my current quant is unsloth's ud-q4_k_xl (i hate it when people are using both "-" and "_"!), but judging by htop, I still have ~30GB more to fill, so I probably can up the quant a notch. But will it help? What's your experience with the model?
Because overall it seems very legit and achieved better results that Qwen 3.5 397B with the same set of tools. Like, I've asked Qwen to plan a project and it did not have a proper web search, only web fetch, so it hallucinated a lot and made up a plan for an app (a dummy 3d "game") using both Vulkan and DX12 simultaneously and with a made up Vulkan version. MiMo then scrapped the plan entirely after reviewing it and managed to actually research a lot with the webfetch alone.
[link] [comments]
More from r/LocalLLaMA
-
The AI race: China's open-weight models trail US closed models by just 7 months
Oct 14
-
Anthropic Executive Says Open-Source AI Models Are Higher Risk
Oct 14
-
ComfyUI v0.40.0 released
Oct 14
-
So this is how they do it --> RTX 5090, once a consumer gaming card, is now on smugglers’ menu alongside cigarettes
Oct 14
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.