LM Studio + Zoo + Qwen 3.6 issues
Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.
I'm currently running an Unsloth quant of Qwen3.6-35B-A3B and I've managed to speed up my output to ~80 tk/s by offloading all experts to CPU. I'm on a Legion 7i laptop, 5080 with 16 GB VRAM. I mainly use the models for Zoo (formerly Roo) integration into VSCode. I'm running into two issues that I'm not sure how to fi, and I can't seem to find anything online.
Somewhere in the LM Studio to Zoo pipeline, my character encoding is mismatched, and so when the model attempts to write a comment with, say, an em-dash, it instead comes out as a few random characters.
The more pressing issue is that when it tries to edit code, it fails on the basis of not having a 100% match. The issue is, the code exactly matches what it aimed to grab, however it ALSO grabbed the few surrounding lines.
If anybody has any advice for this, that would be wonderful. Thanks!
[link] [comments]
More from r/LocalLLaMA
-
The AI race: China's open-weight models trail US closed models by just 7 months
Oct 14
-
Anthropic Executive Says Open-Source AI Models Are Higher Risk
Oct 14
-
ComfyUI v0.40.0 released
Oct 14
-
So this is how they do it --> RTX 5090, once a consumer gaming card, is now on smugglers’ menu alongside cigarettes
Oct 14
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.