b11494: ggml-cuda: assign four GDN state columns per warp (#30087)
Mirrored from llama.cpp releases for archival readability. Support the source by reading on the original site.
-
ggml-cuda: assign two GDN state columns per warp
-
ggml-cuda: use 4 GDN state columns per warp at S_v=128
-
ggml-cuda: default cols_per_warp=4
-
ggml-cuda: address GDN review nits
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.