NInfer 4090 Windows update is out with 1.5-2k t/s prefill, extended MTP, disk caching with DirectStorage, built-in llama.cpp WebUI and more

I've made a few changes here and there to get nearly 2.1k tokens/sec prefill, ~210-230 tokens/sec decode with MTP7 (configurable, extended up to 15) on benchmarks. Also added disk caching options, up to 30GB per config by default for near-instant loads after server restart, built-in llama.cpp WebUI, and some other fixes & improvements.

Tested with: https://huggingface.co/neroued/Qwen3.8-27B-NInfer

Sources: https://github.com/UDPSendToFailed/ninfer-4090