My home data center
Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.
| System 1: Threadripper 3960x 24c 4x 3090 ti 128gb ddr4 System 2: Xeon 8352 36c 4x 5070 ti 128gb ddr4 System 3: Intel 14700k 24c 64gb ddr5 5090 System 4: Ryzen 5950x 16c 64gb ddr4 2x 5070 ti The first system uses two PSUs to handle the almost 2000w full load of the 3090s. Was nervous about this but it has been running stable for about a month. The Intel is an engineering sample that cost $100. I mainly use it to run an embedding model. I use them for various ml experiments, projects and some agentic coding. Right now the 3090s are training a tts lora with data distilled from a larger model. The 5070s run qwen 27b for coding, nemotron streaming stt and moss tts for an interactive agent I am building. These recent qwen models are good enough for coding. Sometimes I leave them all night working on a repo. Mainly boilerplate improvements but its incredible to get real work down with no token cost. Aside from from the obvious costs of this hardware. Love this community ❤️ [link] [comments] |
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.