llama.cpp releases · · 1 min read

b11398: ggml-cpu: support BF16/FP16/FP32 K tails in tinyBLAS on x86 (#29806)

Mirrored from llama.cpp releases for archival readability. Support the source by reading on the original site.

  • ggml-cpu: vectorize BF16 K tails in tinyBLAS

  • tests: Skip tinyBLAS when use_ref is enabled so CPU tests compare against the vec_dot path.

  • ggml-cpu: vectorize tinyBLAS F16/F32 tails

Discussion (0)

Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.

Sign in →

No comments yet. Sign in and be the first to say something.

More from llama.cpp releases