Anyone still doing fine-tunes on consumer grade hardware?
Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.
Felt like there used to be a thriving fine-tuning community a few years back - and then once we started getting models that were smart enough and generalist enough (i.e. post Llama-3-8b era) things kind of dropped off a little. Less need for fine-tunes when prompt-tweaking can get you most of the way if your base is smart enough I suppose? I do miss it - felt like more or less every week I'd open this sub to find some new weird and wonderful thing going on with home brewed models trained on Unsloth or MLX or what-have-you
My gut says that there are still plenty of people doing this, and that the posts just don't surface as much as they used to lol
Bonus question; are there any other subs out there that are more dedicated to training models locally that I just haven't come across yet?
[link] [comments]
More from r/LocalLLaMA
-
Qwen 3.8 Flash Next locally on simple mobile phone at 3.5 tok/s
Aug 30
-
Unpopular opinion Qwen 3.8 is hard to understand
Aug 30
-
Qwen3.8-Flash-Next turns 4xR9700 into a local AI powerhouse! 120 t/s TG and 12k t/s PP single request with optimized vLLM
Aug 30
-
Oh so that's where my PCIe lanes went...
Aug 30
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.