Boole-1.7B: A 1-bit Qwen3-1.7B model that outperforms Bonsai-1.7B
Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.
| We're launching Precision Numerics by releasing Boole-1.7B, a 1-bit version of Qwen3-1.7B.
Try it locally in your browser (it's for low-latency tasks using English and non-thinking mode), or use it with vLLM or llama.cpp. We'll ship more capable models for the open-source community. Let us know what you what models/capabilities you want to see next.
[link] [comments] |
More from r/LocalLLaMA
-
The AI race: China's open-weight models trail US closed models by just 7 months
Oct 14
-
Anthropic Executive Says Open-Source AI Models Are Higher Risk
Oct 14
-
ComfyUI v0.40.0 released
Oct 14
-
So this is how they do it --> RTX 5090, once a consumer gaming card, is now on smugglers’ menu alongside cigarettes
Oct 14
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.