llama.cpp releases · · 1 min read

b11517: CUDA: pass src1 precision to host MMQ config helpers (#30168)

Mirrored from llama.cpp releases for archival readability. Support the source by reading on the original site.

  • CUDA: pass src1 precision to host MMQ config helpers

Signed-off-by: ynankani ynankani@nvidia.com

  • make src1 prec explicit

Signed-off-by: ynankani ynankani@nvidia.com


Signed-off-by: ynankani ynankani@nvidia.com

Discussion (0)

Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.

Sign in →

No comments yet. Sign in and be the first to say something.

More from llama.cpp releases