Ornith-1.5-35B-A3B-NInfer - 250 tok/s, 5-8k prefill, 5090
Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.
| | I tried this model yesterday, and it felt to me like the best one I've tried for a local model for interactive use; the responses and reasoning are very fast, and it actually performs agentic tasks well. The speed is phenomenal. I am running this on Ninfer for Windows - https://github.com/natpate/ninfer-windows [link] [comments] |
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.