r/LocalLLaMA · · 1 min read

Heat!

Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.

As in actual physical heat. How are people coping with the heat that running a decent inference rig pumps out? I've got dual 5060 Ti GPUs and a relatively modest CPU (Intel 14 Core Ultra 5 245KF Desktop on an Msi MPG Z890 motherboard) and if I use it for a coding session or similar with Qwen 3.8 27B then it heats up the room terribly. I know the energy consumed has to go somewhere, but I didn't realise it would be this bad. Would throttling the GPUs' power consumption a bit make any difference? They hit about 170W each at full tilt.

submitted by /u/andrewh2000
[link] [comments]

Discussion (0)

Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.

Sign in →

No comments yet. Sign in and be the first to say something.

More from r/LocalLLaMA