little tool for offline wikipedia RAG
Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.
| I was bored and handwrote a tiny 100-line bash script to let an agent search for and read articles from an offline wikipedia archive during a regular chat. It's not particularly useful, but it's definitely neat and a big step up from llama-cli. I got surprisingly good results even with LFM2.5-2B (Q8 at 0.5 temp), which is usually too weak to be of much use. (and Qwen had no trouble, obviously— see main image) Just point it at your llama-server endpoint and chat away! Or whatever. The handwritten writeup has more examples and a pretty comprehensive overview of how it works— I was surprised how simple the llama-server API is for general agentic stuff and toolcalling. Makes me want to make a proper harness... edit: forgot to link github, but you should read the writeup instead 🙃 [link] [comments] |
More from r/LocalLLaMA
-
The AI race: China's open-weight models trail US closed models by just 7 months
Oct 14
-
Anthropic Executive Says Open-Source AI Models Are Higher Risk
Oct 14
-
ComfyUI v0.40.0 released
Oct 14
-
So this is how they do it --> RTX 5090, once a consumer gaming card, is now on smugglers’ menu alongside cigarettes
Oct 14
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.