Qwen3.8-Next streaming - 150tps prefill, 3.6 tps decode on M5 Air

Out of curiosity, I thought I'd see if I could adapt my DSv4 streaming stack from a few weeks ago to take Qwen3.8-Next. It worked, better than I thought - it actually runs faster on my 32GB M5 than the dense 27b does (admittedly not apples to apples as I decided to use a 3bit of the MoE, Qwen3.8-Flash-Next-MLX-oQ3-MTP, and the dense was 4bit).

For a 2k token prompt, running on low power mode on my M5, 3.8-Next-3bit gets 150 tps prefill, 3.6 tps decode. 27b-4bit gets 70tps prefill, 3 tps decode