llama.cpp releases · · 1 min read

b11450: RPC: add `-sm tensor` (#26610)

Mirrored from llama.cpp releases for archival readability. Support the source by reading on the original site.

  • rpc: allow -sm tensor

  • fix flush for apple rdma

  • move graph_uids to rpc_dispatcher

  • cont : fix conflict

  • cont: stop spinning dispatcher thread

  • remove meta backend change

  • add TODO to simplify logic

  • rpc: bump major version


Co-authored-by: Georgi Gerganov ggerganov@gmail.com

Discussion (0)

Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.

Sign in →

No comments yet. Sign in and be the first to say something.

More from llama.cpp releases