llama.cpp releases · · 1 min read

b11580: hexagon: extend scalar DMA broadcasting support for binary ops (#30245)

Mirrored from llama.cpp releases for archival readability. Support the source by reading on the original site.

  • tests: cover weighted scalar broadcasts

Assisted-by: OpenCode

  • ggml : support extended scalar DMA binary ops

Assisted-by: OpenCode

  • hex-binary: remove all non-dma paths

  • hex-binary: add support for non-contig strides and cleanup dma preable a bit

  • hex-binary: cleanup the gating and simplify dma retry

  • hex-geglu-erf: add a gate for F32 only, we dont support F16 for this op

  • tests: cover weighted repeat broadcast

Assisted-by: OpenCode

  • hex-binary: update REPEAT and COMPLEX kernels to use dma as well (missed them last time)

  • hex-add-id: add dma support for src2 (idx)


Co-authored-by: Max Krasnyansky maxk@qti.qualcomm.com

Discussion (0)

Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.

Sign in →

No comments yet. Sign in and be the first to say something.

More from llama.cpp releases