What’s the maximum physical amount of intelligence we can fit into small models?
Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.
I was talking to my friend the other day, who is a really avid supporter of local models. He thinks we might be able to get something as intelligent (not smart in terms of how much it knows) as Claude Fable in inside a model which is like, 20 billion parameters, even if we’d get that in 2035.
While I don’t know much about small models since I’ve only recently come from the closed-source labs, is this even possible? I say no. And what is the minimum model size you think someone would need to host something as capable as Fable 5?
[link] [comments]
More from r/LocalLLaMA
-
The AI race: China's open-weight models trail US closed models by just 7 months
Oct 14
-
Anthropic Executive Says Open-Source AI Models Are Higher Risk
Oct 14
-
ComfyUI v0.40.0 released
Oct 14
-
So this is how they do it --> RTX 5090, once a consumer gaming card, is now on smugglers’ menu alongside cigarettes
Oct 14
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.