r/LocalLLaMA · · 1 min read

The Unsloth appreciation post. BIG thanks to Daniel and Michael! Thanks from the community to you guys for so much!

Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.

With HF being bought out and its future feeling a little iffy, I got to thinking about the teams that have constantly looked out for the little guys and stayed true to their open-source roots. There are great developers who share their work freely, and the local AI scene is incredible for it—one user once described it as "having Xmas every day," and that stuck with me.

Unsloth in particular has worked tirelessly to bring high-quality quants to lower-end GPUs, super-fast GGUFs for everyone to test, and every time I see Daniel or Michael post, they're always humble and helpful.

The last few days must have been non-stop for them with all the latest model drops. Daniel was right there pushing PRs for new architecture support (including keeping huge n-gram structures streaming properly from disk from day one).

Huge respect to u/danielhanchen and u/yoracale. Keep up the most epic work!

submitted by /u/Uncle___Marty
[link] [comments]

Discussion (0)

Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.

Sign in →

No comments yet. Sign in and be the first to say something.

More from r/LocalLLaMA