r/LocalLLaMA · · 1 min read

M5 Ultra Mac 256GB Studio - 64 core vs. 80 core version, is the inference speed difference worth the extra 10 weeks wait time?

Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.

I’m seeing 6-7 week delivery wait time for M5 Ultra Mac Studio 64 core version versus 15-17 weeks for 80 core version. They both Ultra and have the same memory bandwidth. Is the speed difference that noticeable for prompt processing and token generation? Is it worth the $1200 price difference and extra 10 weeks wait time? I don’t think I’ve seen inference stats for the 60 core version from anyone. What are y’all going to buy?

submitted by /u/Porespellar
[link] [comments]

Discussion (0)

Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.

Sign in →

No comments yet. Sign in and be the first to say something.

More from r/LocalLLaMA