r/LocalLLaMA · · 1 min read

Anyone using TensTorrent gpus for your local ai? What's been your experience?

Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.

I'm always keeping an eye on competitive hardware and was looking at tenstorrent cards, particularly the p150a which while its memory bandwidth is only 512GB/s, it does have 32 GB of GDDR6 and a high-speed Ethernet fabric (4×800 GbE) so multi-card systems don't rely on PCIe alone. something like this is exciting because in 1 or 2 card generations they could potentially be a better local ai gpu than Nvidia or amd since its 1/3rd the price of a 5090 and has native GPU meshing (rip nvlink).

is anyone here is actually ruuning the p150a (or any other of their other cards) for local AI? How mature is the hardware + software stack currently? would you buy into the platform again?

submitted by /u/tat_tvam_asshole
[link] [comments]

Discussion (0)

Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.

Sign in →

No comments yet. Sign in and be the first to say something.

More from r/LocalLLaMA