Waiting for a 122B because of world knowledge?
Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.
Any LLM will hallucinate the world knowledge, even a 3T model. Use a 4B with a kiwix skill and local Wikipedia, 50gb and no more hallucinated world knowledge.
Ask your coding agent to build your own, with your rules and eventual fallback access to internet knowledge for what's updated realtime like news, or isn't public on Wikipedia.
EDIT: I forgot to mention that adding a simple agent loop with a well crafted looping/research skill may help less intelligent LLMs to be good enough for getting grounded knowledge very fast. I did it with my old laptop, 10 years old with 4gb vram. And by eyeball - on world knowledge - it's faster and more precise than any huge LLM running on a costly rig, occupying hundred of storage GB and consuming a lot of energy. IMO
[link] [comments]
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.