llama.cpp Windows Manager

https://github.com/alekk89/llama-cpp-windows-manager

It has been three months since I first shared my personal solution for running llama.cpp on Windows, and the project has evolved considerably since then.

The goal was to create a simple visual interface for managing llama.cpp runtimes, switching between coding models, and keeping multiple local endpoints available simultaneously without relying on scripts or manually managed server processes.

The application is open source and available as either a Windows installer or a portable ZIP.

Some of the capabilities include:

• Create multiple launch profiles for each model
• Run multiple models simultaneously
• Access every model through a shared OpenAI compatible gateway or separately
• Set up native Windows and WSL runtimes with guided workflows
• Track lifetime performance metrics for models and profiles
• Configure launch settings through a visual interface with clear descriptions
• Switch to a simplified view containing the most commonly used settings
• Group models for coordinated loading, automatic rollback, and idle unloading
• Monitor live performance, server logs, slots, and resource usage
• Automate model management through the authenticated control API and llwmctl

I have seen a few similar projects appearing recently, so I thought this might be useful for anyone who wants this kind of application without having to build and maintain their own solution from scratch.

Feedback, bug reports, and feature suggestions are welcome.