We quantized the new Ornith 1.5 9B and 35B-A3B

ornith lab dropped new ornith 1.5 today, a 9B dense with vision and a 35B-A3B MoE, both MIT, trained on a loop that generates its own tasks. in addition there was giant 397b model, but we didn't quantize it (but if you want to try - we will do it)

we made our AD (Atomic Dynamic) quants for both, 9B (14 builds) and 35B-A3B (13 builds), and measured them against stock llama.cpp quants (on the same imatrix) their mean KLD and top-1 against our own BF16 conversion

Ornith-1.5-9B

Ornith-1.5-35B-A3B

Collections on HF with the imatrix, the per-tensor layouts and everything else: https://huggingface.co/collections/AtomicChat/ornith-15-9b
https://huggingface.co/collections/AtomicChat/ornith-15-35b-a3b

Our local ai open source app https://atomic.chat (I'm cofounder). Feel free to ask any questions and share your feedback!