Cool stuff to do with NVIDIA RTX 6000 PRO 96GB VRAM
Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.
I have been a C++ dev for 3 years as long as have done PyTorch in my free time (not that good in the latter).
Now, I was lucky enough to get a brand new GPU from a colleague. What are some cool side projects I can build to learn tons about ML and inference/infra? Please don't respond saying "anything you like" as there's nothing I prefer at the moment.
I am completely new - so sorry if it's an obvious question!
[link] [comments]
More from r/LocalLLaMA
-
6x P40 running Minimax M2.7_Q3_XL
Jul 2
-
Fine-tuned Gemma-4-31B specifically for Copywriting & Creative Writing Tasks (Scored +290 Elo over base using EqBench3)
Jul 2
-
Gemma 4 WebGPU Kernels 255 tok/s by x/@xenovacom
Jul 2
-
openlumara, my manually coded super-token-efficient harness, now works across any UI that can connect to an openAI endpoint! koboldlite, openwebui, you name it. basically, openAI bridge. yay!
Jul 2
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.