Using llama.cpp with pi

A lot of people have their own setups using pi with llama.cpp. I have my own so thought I'll share. This is the extension I and deepseek wrote: https://github.com/am17an/pi-llama-server . It allows you to do two very simple things: auto detect a llama-server running and list the models available. Here is a demo gif (sorry about poor quality):

That's it - that's the post. Enjoy more free software! I am infact trying to make this a completely local AI driven repo since it's a simple plugin, so any feature request/bug will be routed through Deepseek V4-flash running on my DGX Spark first.