Ling and Ring 2.6 Technical Report: Efficient and Instant Agentic Intelligence at Trillion-Parameter Scale

arXiv : https://arxiv.org/abs/2606.15079

Full Paper : https://arxiv.org/pdf/2606.15079

HuggingFace : https://huggingface.co/inclusionAI/models?sort=created

(This month they released base models for both Ling-2.6-1T & Ling-2.6-flash)

--------------------------

Wish they released Ling-mini for 2.6 :( which's good for Poor GPU Club. (At least they released Ling-2.6-flash(100B), 24/32GB VRAM users could enjoy Q4)

Was talking about Ling-mini-2.0 which's 16B-A1.4B. So faster one. Posted a thread last Jan. bailingmoe - Ling(16B) models' speed is better now

TLDR of above thread:

- Ling-mini-2.0-IQ4_XS - 160 t/s (on 8GB VRAM) - I would love to get 30-50B model from them to get fastest t/s from medium size model. Based on simple math, I would get 80 t/s for 30B Q4 with same 8GB VRAM.

- Ling-mini-2.0-IQ4_XS - 50-70 t/s (on CPU-only inference - 32GB RAM)

No other models given me such faster t/s. Till-date surprised about such faster t/s from CPU-only inference. So faster than even 1-bit version models.