b11405
Mirrored from llama.cpp releases for archival readability. Support the source by reading on the original site.
cuda: tile the lightning indexer over keys and tokens for 4 heads (#2…
Mirrored from llama.cpp releases for archival readability. Support the source by reading on the original site.
cuda: tile the lightning indexer over keys and tokens for 4 heads (#2…
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.