LiquidAI/LFM2.5-Encoder 250M/350M
Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.
LFM2.5-Encoder-350M is a multilingual bidirectional encoder built on the LFM2 architecture — a larger encoder for maximum downstream quality. It is a masked language model with full bidirectional attention, designed to be fine-tuned into task-specific models (classification, token classification, retrieval, reranking, and semantic similarity) across 15 languages, and to run efficiently on-device.
- Highly capable for its size. On par with the best similarly sized encoders and well ahead of our own retrieval siblings.
- General-purpose. 8k context, strong across NLI, paraphrase, sentiment, and multilingual tasks.
- Fast and on-device. Matches or beats ModernBERT throughput, with a long-context edge on CPU; runs in the browser on WebGPU.
https://huggingface.co/LiquidAI/LFM2.5-Encoder-350M-GGUF
https://huggingface.co/LiquidAI/LFM2.5-Encoder-230M-GGUF
https://github.com/ggml-org/llama.cpp/pull/29862
example (from the hf):
❯ uv run fill-mask.py LFM2.5-Encoder-350M-F16.gguf "The capital of France is [MASK]." top-5 at [MASK]: # 1 11.42 ' Paris' # 2 10.43 'Paris' # 3 9.65 ' Nice' # 4 8.94 ' Strasbourg' # 5 8.62 ' Lyon' [link] [comments]
More from r/LocalLLaMA
-
The AI race: China's open-weight models trail US closed models by just 7 months
Oct 14
-
Anthropic Executive Says Open-Source AI Models Are Higher Risk
Oct 14
-
ComfyUI v0.40.0 released
Oct 14
-
So this is how they do it --> RTX 5090, once a consumer gaming card, is now on smugglers’ menu alongside cigarettes
Oct 14
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.