Let’s all thank Georgi Gerganov who gave use llama.cpp
Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.
| | I was looking into the story a bit further earlier. Very interesting. Couldn’t have done it without him [link] [comments] |
More from r/LocalLLaMA
-
Are there any interesting architectural innovations that we seem to be on the verge of for LLM models or AI models that might be a big deal? (Excluding maybe N-gram, since everyone is already well aware of that one)
Aug 30
-
Demo of local document extraction (52 pages) using Arctic Embed and Bonsai 8B on an Iphone 16 (KernelAI app)
Aug 30
-
Will apple still release devices with mobile HbM in 2027 ?
Aug 30
-
NVIDIA® DGX Station™ Delivering Data-Center-Class Performance from the Desktop
Aug 30
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.