r/LocalLLaMA · · 1 min read

Ornith-1.5 9B might not be bad at all

Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.

(my own experience)

I have a mid-range gaming laptop from 2024 with 4GB VRAM and 16GB RAM. There is nothing that I can run other than small models at humble t/s.

I mostly use the models to generate scripts for medical physics research (don't worry, I verify them before any use, no one is getting vaporized). My "benchmark" consists of 6 typical tasks, nothing too fancy.

I have tried Ling-3.0 Tiny, Qwen 3.5 4B, Empero's 2B and 4B distills, and now Ornith's new 9B model.

3.5 4B did the worst, only 2/6 tasks, Ling and Empero's did 3/6, and could not get the other 3 to work with any amount of feedback.

Ornith one shot 5/6 tasks with no problem. It couldn't do one of the tasks, but it took feedback and improved parts of the code, being the first model in the set to do so.

It also got the car wash question right!

submitted by /u/zippydazoop
[link] [comments]

Discussion (0)

Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.

Sign in →

No comments yet. Sign in and be the first to say something.

More from r/LocalLLaMA