r/LocalLLaMA · · 1 min read

Software developers appreciation post

Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.

Im on the bus to work and just felt like i dont see enough grattitude for the men, women, children, and people who contribute thier time and effort on open projects.

Just last night i saw ive been sleeping while vllm developers are releasing 3 new major releases, and not only that, the issues with OOM caused by preallocations and tuning seem to be gone!!!amazing!! Just fixing that bug has allowed me to double my context window size 120k to 240k with qwen27b on 5090.

So this is just a reminder to support open source developers, infrastructure, and update your software. When we work honestly in the open, software gets better to use over time, not worse.

Its never easy and can be very emotionally difficult for all involved ( contributors feeling like they are not welcome even tho they are just trying to help, and maintainers burned out by everyone acting like the maintainer owes them something )

So all in all remember to have respect and grattitude, because open software really does keep the world turning. I hope to see more as my generation starts saving/aging thier way out of the rat race.

submitted by /u/transanethole
[link] [comments]

Discussion (0)

Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.

Sign in →

No comments yet. Sign in and be the first to say something.

More from r/LocalLLaMA