Software developers appreciation post
Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.
Im on the bus to work and just felt like i dont see enough grattitude for the men, women, children, and people who contribute thier time and effort on open projects.
Just last night i saw ive been sleeping while vllm developers are releasing 3 new major releases, and not only that, the issues with OOM caused by preallocations and tuning seem to be gone!!!amazing!! Just fixing that bug has allowed me to double my context window size 120k to 240k with qwen27b on 5090.
So this is just a reminder to support open source developers, infrastructure, and update your software. When we work honestly in the open, software gets better to use over time, not worse.
Its never easy and can be very emotionally difficult for all involved ( contributors feeling like they are not welcome even tho they are just trying to help, and maintainers burned out by everyone acting like the maintainer owes them something )
So all in all remember to have respect and grattitude, because open software really does keep the world turning. I hope to see more as my generation starts saving/aging thier way out of the rat race.
[link] [comments]
More from r/LocalLLaMA
-
Unpopular opinion Qwen 3.8 is hard to understand
Aug 30
-
Qwen3.8-Flash-Next turns 4xR9700 into a local AI powerhouse! 120 t/s TG and 12k t/s PP single request with optimized vLLM
Aug 30
-
Oh so that's where my PCIe lanes went...
Aug 30
-
Uncensored Multi-Model Releases, LongCat-Flash-Lite-Sparse with MTPs and LSAs, Qwen3.8-27B with MTPs, Qwen3.5-122B-A10B with MTPs, Qwen3-Coder-Next and Laguna-S2.1 with Vision, All Available in GGUF Format! Bonus: Links to my llama.cpp Fork for LongCat-Flash-Lite Support and…
Aug 30
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.