b11417: CUDA: Optimize accumulation in mmq for NVFP4 type (#29857)
Mirrored from llama.cpp releases for archival readability. Support the source by reading on the original site.
-
ggml_cuda: optimize accumulation in mmq_vec_dot_fp4_fp4_mma for better performance
-
remove whitespace
-
fix: correct indentation in mma_block_scaled_fp4 loop
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.