News / #model-release Tag Model releases 500 articles archived under #model-release · RSS Sign in to follow r/LocalLLaMA community 11d ago What is the best Qwen3.8 27b Abliterated version out there? I'm trying to get a model to reverse engineer / decompile or otherwise reverse to source some of my old c,c++, pascal, and asm demo programs I made from decades ago and I'm constantly met with refusals. It is highly annoying. Does anybody know of a good abliterated/uncensored… 24 r/LocalLLaMA community 11d ago I tested DFlash2 for Qwen3.8 27B on a 5090 Here's the DFlash2 announcement , and I was pretty excited for this after trying out DSpark on llama.cpp a few days ago and being somewhat disappointed that it wasn't really working. Anyways, I spent a while setting it up (you need to rebuild llama.cpp with pr #27342). Here's my… 19 TechCrunch — AI news-outlet 11d ago Cursor capitalizes on GitHub frustration, launches rival hosting platform Cursor, known for its AI Code Editor, is launching a new code-hosting platform to rival developers' long preferred favorite, GitHub. 37 Simon Willison community 11d ago Mojo🔥 is now open source Mojo🔥 is now open source Mojo🔥 is now open source The Mojo programming language has been promising an open source release since May 2023 . Last week they shipped their 1.0 and today they have followed through on that original promise, releasing the compiler and toolchain under… 7 r/LocalLLaMA community 11d ago DFlash 2 available for Qwen 3.8 27B and Muse Glimmer Apparently a second version of DFlash from the original authors of DFlash GGUF quants are already made available with an accompanying llama.cpp PR: https://github.com/ggml-org/llama.cpp/pull/27342   submitted by   /u/rerri [link]   [comments] 10 r/LocalLLaMA community 11d ago Alibaba's RISC-V CPU, XuanTie C950, Runs Qwen-3.8 27B at 30 tps Who needs GPUs?   submitted by   /u/DeltaSqueezer [link]   [comments] 25 OpenAI official-blog 11d ago Strengthening Democratic Oversight in National Security OpenAI launches an initiative to strengthen democratic oversight of AI in national security, supporting government institutions with tools, training, and expertise. 25 r/LocalLLaMA community 12d ago 1-bit / 2-bit / Ternary / Bitnet Models - Updates & Tracking Bonsai / Ternary Bonsai During April Bonsai came with bunch of models .... 1-bit & 1.58-bit(Ternary) versions. And last month(July) they released 27B models in same versions. Last month itself, Bonsai-27B was able to run on all backends mainline. But Ternary-Bonsai-27B was not… 38 r/LocalLLaMA community 12d ago Ling-3.0 (BailingMoE3) lands in llama.cpp mainline - Quick benchmarks on Intel Arc B580 Finally llama.cpp now officially supports Ling-3.0! (Starting from build b10472 +) If you want to run them locally, bartowski has already released the GGUF imatrix quantizations for both models: - Ling-3.0-tiny (8B) - Ling-3.0-flash (127B) After quite a while, PR #26608 has… 33 r/LocalLLaMA community 12d ago Idea: massively compress Qwen 3.8 KV cache by using a single bit for the token "wait" Not even sure if I'm joking, my thinking history is about 50% "wait".   submitted by   /u/pixelpoet_nz [link]   [comments] 14 r/LocalLLaMA community 12d ago Qwen3.8 2.4T open weights made a Call of Duty clone Qwen released the 2.4T Max weights and I was curious how well it can re-create COD in one prompt I ran the model on a rented B200 cluster and used roughly 1.1M output tokens over a 5 hour time span Realistically barely anyone can run this model locally, but the fact that it's… 18 LangChain releases dev-tools 12d ago langchain-openai==1.5.2 Changes since langchain-openai==1.5.1 release(openai): 1.5.2 ( #39719 ) fix(openai): preserve reasoning item boundaries ( #39278 ) release(openai): 1.5.2a1 ( #39709 ) feat(openai): extract gateway metadata from response headers when available ( #39706 ) chore(openai): update… 9 r/LocalLLaMA community 12d ago I pushed Qwen3.8-27B to 124 tps on a single request on a RTX 3090 Two days ago I released a hyper-optimized Qwen3.8-27B inference engine for an RTX 3090 (82 tps single request, 672 peak) - yesterday's update took that to 99 tps single-user / ~1,000 tps at 64 concurrent. Since then I've focused on the single-request number, again without… 31 Hacker News — AI on Front Page community 12d ago Claude Code May–August 2026 weekly limits promotion Article URL: https://support.claude.com/en/articles/15910845-claude-code-may-august-2026-weekly-limits-promotion Comments URL: https://news.ycombinator.com/item?id=49348751 Points: 213 # Comments: 157 27 r/LocalLLaMA community 12d ago Qwen3.8-27B: slower tokens, faster and better results   submitted by   /u/surreal_tournament [link]   [comments] 30 r/LocalLLaMA community 12d ago Running DeepSeek V4 Flash Q4_K_XL at ~100 tok/s prompt processing on 4× RTX 3060 12GB I managed to run the 143–144 GiB DeepSeek-V4-Flash-0731 UD-Q4_K_XL GGUF on four RTX 3060 12GB cards while keeping a 360k–376k context window. Hardware: CPU: Intel Core i9-10920X, 12C/24T RAM: 128 GB DDR4-3200, quad-channel GPU: 4× NVIDIA RTX 3060 12GB Total VRAM: 48 GB Storage:… 25 r/LocalLLaMA community 12d ago Is Ling 3 tiny underrated for its size? I was checking out benchmarks of this model and apparantly better than Qwen3.5 9b reasoning across the bench on artificial analysis. I have used the 9b model for variety of stuff and it has been amazing, but if this is better then why not switch. I am downloading it rn to test… 6 TechCrunch — AI news-outlet 12d ago OpenAI launches a safer ChatGPT for teens — years after teens started using it ChatGPT for Teens adds age-appropriate safety measures, parental controls, and learning tools designed to steer teens away from harmful content — and from using AI to cheat on their homework. 17 r/LocalLLaMA community 12d ago OpenCode overrides the samplers for Qwen models to the wrong values This is invisible with llama.cpp or derivatives, but ninfer helpfully logs the sampler settings on each request and auto-configures the correct ones for the model. Basically, OpenCode will always send top-p=1.0 (which means there is no filtering of low-probability tokens except… 17 Hacker News — AI on Front Page community 12d ago Claude writing a macOS driver for my obscure HP printer built only for Windows https://xcancel.com/kuberwastaken/status/2089377982536388964 https://cdn.kuber.studio/chat/hp-laser-1008a-driver Comments URL: https://news.ycombinator.com/item?id=49344643 Points: 248 # Comments: 185 5 r/LocalLLaMA community 12d ago DeepSeek V4 Flash 0731 on Strix Halo: draft model, n_max sweep, and a launch line that actually helps I know the front page is completely dominated by the Qwen3.8 27B. I know it's a fantastic model and everyone is rightfully discussing it, but I wanted to shift gears and talk about another model I’ve been experimenting with and got some solid results from:… 9 OpenAI official-blog 12d ago Introducing ChatGPT for Teens: Built for learning, backed by protections ChatGPT for Teens helps teens learn, think critically, and use AI with confidence, with stronger built-in protections, healthy-use features, and additional controls for parents. 10 MIT Technology Review — AI news-outlet 12d ago We still don’t know how people are really using AI AI companies like Anthropic and OpenAI regularly publish reports on how people are using products like Claude and ChatGPT, but they only release the data they want us to see, AI researchers say.  “There is no independent source to corroborate it,” says Anka Reuel, a… 30 Hugging Face Daily Papers research 12d ago Advancing Open and Reproducible Relational Learning: RelArena-α, TabPFN-Rel and RPI Abstract Prior Labs released open-source tools including a unified relational benchmark framework, a TabPFN-based relational model, and a model-agnostic predictive interface to advance reproducible relational learning. Generated by thinkingmachines/Inkling-Small This first… 21 r/LocalLLaMA community 12d ago Qwen 3.8 27b saved me $650+ in API costs this evening I've been experimenting with Qwen3.8-27B using DeepSeek Harness. It's a monster at long-horizon tasks, and the results were pretty wild. DeepSeek Harness ran on my Windows PC and connected over LAN to NInfer on a separate RTX PRO 6000 box. The model was Qwen3.8-27B with a 262K… 23 r/LocalLLaMA community 12d ago Qwen 3.8 27B is faster than expected i ran this model on my two 5060 TI 16GB cards at Q4 in unsloth and LM studio ( i downloaded NVFP4 but didn't try it in vLLM ) i think it runs faster than expected it gives me 50 - 60 t/s with MTP. this is surprising because it's a dense model and Qwen 3.6 was giving me 30t/s… 34 r/LocalLLaMA community 12d ago Qwen 3.8 27b vs Deepseek Flash Hey Guys, What amazing weeks it has been for open source releases. I was really impresssed by DS flash final checkpoint and i have been playing around with it until qwen 3.8 released. I checked the benckmarks, and I dont know what to think anymore how can such a small model… 6 r/LocalLLaMA community 12d ago Qwen 3.8 27B xhigh vs medium small comparison (+ others for fun) It's a small experiment of mine to check thinking effort on Qwen and I do have to say xhigh does overthink but I'm not sure if it's bad because the result is rather amazing. Although the prompt was very open-ended so it took liberties. TL:DR at the bottom. Images in order: Qwen… 29 r/LocalLLaMA community 12d ago AA is the reason for Qwen3.8 27B shipped with xhigh I know why Qwen3.8 27B shipped with xhigh reasoning as default, it's to do its best in benchmarks. Models from top labs often get benchmarked at multiple reasoning levels, but that same treatment doesn't apply to other labs. Open models are lucky to even be benchmarked at all.… 16 arXiv — Machine Learning research 12d ago Is Grokking a Loss of Normal Hyperbolicity of the Interpolation Manifold? arXiv:2608.14803v1 Announce Type: new Abstract: A recent line of work recasts the post-memorization phase of grokking as constrained optimization: once a network interpolates the training set, weight decay drives a slow drift along the zero-loss manifold toward lower norm. In… 36 arXiv — NLP / Computation & Language research 12d ago IndicQE-APE: A Benchmark for Quality Estimation and Automatic Post-Editing for Indic Languages arXiv:2608.16344v1 Announce Type: new Abstract: Indic quality estimation (QE) and automatic post-editing (APE) data is spread across separate releases, so no single resource supports training and evaluation across tasks and language pairs on one footing. We consolidate the WMT… 18 arXiv — NLP / Computation & Language research 12d ago Mint-Agent: Introducing Finance-Native Agentic Foundation Models arXiv:2608.16386v1 Announce Type: new Abstract: Financial agents must do more than recall domain knowledge: they must be both reliable, executing precise operations over grounded evidence, and executive, sustaining long-horizon research whose conclusions remain auditable. We… 21 r/LocalLLaMA community 12d ago Qwen dev says not to wait for 35B-A3B What does this mean? Is there something else coming? Maybe 122B? Or no models?   submitted by   /u/Mean-Ad1493 [link]   [comments] 13 r/LocalLLaMA community 12d ago Optimizing Qwen3.6 / Qwen3.8-27B on 16GB VRAM: Complete Benchmark Results and Setup Guide (~30-50tps at 32k to 72k context) This post was made with AI. I tried to remove as much slop as possible and keep it straight to the point to save your time as I know how annoying AI slop posts can be, but I still wanted to retain all the details so it can be used as a resource for comparison with other future… 38 LangChain releases dev-tools 12d ago langchain-openai==1.5.2a1 Initial release release(openai): 1.5.2a1 ( #39709 ) feat(openai): extract gateway metadata from response headers when available ( #39706 ) chore(openai): update snapshots ( #39657 ) fix(openai): support o-series models in get_num_tokens_from_messages ( #38710 ) release(openai):… 6 r/LocalLLaMA community 12d ago Made this game in two prompts with Q4, Qwen 3.8 is amazing This took one prompt to build, and another follow up prompt to fix two issues (player got stuck with the bomb and broken enemies path-finding), this is only html, css and js, no external assets, all done by Qwen. Using UD-Q4_K_XL in llama.cpp with 128k context and k5_0/v4_1… 36 Vercel — AI dev-tools 12d ago Cline is now available in the AI SDK harness layer The AI SDK harness layer lets you run established coding-agent runtimes through one unified interface, so you can switch runtimes without changing your application code. Today we are adding Cline, which runs through the same HarnessAgent interface as other supported harness.… 11 Vercel — AI dev-tools 12d ago GLM 5.3 now available on AI Gateway GLM 5.3 from Z.ai is now available on AI Gateway. GLM 5.3 has improvements vs. GLM 5.2 at complex software engineering and at agent tasks that run across many steps, and it reaches those results while producing fewer output tokens than GLM 5.2 did at the same effort level. Z.ai… 30 Simon Willison community 12d ago Qwen 3.8 27B scores 52 on the Artificial Analysis Intelligence Index Qwen 3.8 27B scores 52 on the Artificial Analysis Intelligence Index That's the same score as GPT-5.6 Luna (max), and just one point behind GLM-5.2 (max) and DeepSeek V4 Pro 0813 (max) - that GLM is 753B and that DeepSeek is 1.6B parameters, and Luna is size unknown but… 8 r/LocalLLaMA community 12d ago Waiting for Qwen 3.8 35B A3B   submitted by   /u/puffyarizona [link]   [comments] 6 r/LocalLLaMA community 12d ago Qwen 3.8 35b and 122b - We hope/wait/beg for models incessantly. But how do we actually give the lab more incentive to make it? So many comments begging for these models, and I get it. People from the labs frequent r/LocalLLaMA , so maybe the begging comments aren't useless. They make demand known at least. Same with polls, etc. But what could this community do to actually help the lab, or somehow give… 11 r/LocalLLaMA community 12d ago we benchmark models nobody actually runs qwen3.8-27b looks genuinely impressive on the benchmark tables - beating models many times its size on some of them. but those numbers come from bf16 weights, and nobody here is running a 27b at bf16. we're running the 4-bit at ~17gb because that's what fits on a 4090 or a 24gb… 16 LangChain releases dev-tools 12d ago langchain-core==1.5.6 Changes since langchain-core==1.5.5 chore(core): release 1.5.6 ( #39704 ) feat(core): incorporate gateway metadata to traces ( #39703 ) 28 r/LocalLLaMA community 12d ago Qwen3.8-27B Uncensored Aggressive is out with K_P quants and HauhauCS FastMTP (up to 3.02x TG)! The dense Qwen release is back! Qwen3.8-27B Uncensored Aggressive is out with the complete K_P quant range, Vision, native NextN, and HauhauCS FastMTP. Aggressive here means no refusals, no personality alterations, and very little preamble on difficult prompts. It keeps… 5 Hacker News — AI on Front Page community 12d ago GPT-5.6 Sol Pricing Cut by 50% Article URL: https://openrouter.ai/openai/gpt-5.6-sol Comments URL: https://news.ycombinator.com/item?id=49337602 Points: 492 # Comments: 307 18 r/LocalLLaMA community 12d ago Local agentic coding Benchmark : Qwen 3.8 27B (in many weights quants / cache quants / engine / reasoning effort) vs others. In medium reasoning mode, it both scores higher than the 3.6 version, AND is very much more efficient (almost half requests needed, and a third less tokens generated) - at DeepSeek v4 Flash 3107 MXFP4 level The xhigh mode is advertised to be the best one for hard tasks. In this… 32 r/LocalLLaMA community 12d ago Weirdly, no one talks about Temperature setting for the Qwen3.8 27b Mind you, it is 1.0 by default, yet everyone is focused on how much the new model thinks, restricting the reasoning budget and/or dropping the reasoning level. Set the temperature to 0.7 and the model will no longer write a whole book of thoughts before trying to make a small… 8 r/LocalLLaMA community 12d ago I pushed Qwen3.8-27B to 99 tps single request and 1150 tps with a batch request on a RTX 3090 I'm back. Yesterday I released the first version of hyper-optimized Qwen3.8-27B inference engine for a RTX 3090, reaching 82 tps on single request and 672 peak. Over the last 24 hours I've been exploring how to improve it further (without a quality degredation). Yesterday we had… 23 r/LocalLLaMA community 12d ago "Opus 4.8 thinks too much", "Muse Glimmer sits between Gemma and Qwen, that's boring", "Gemma 4 is too lazy" I'm starting to think there's no way to make a reasoning model that won't draw persistent vocal complaints on here. EDIT: Qwen 3.8 not Opus 4.8*, freudian slip lol   submitted by   /u/MerePotato [link]   [comments] 29 r/LocalLLaMA community 13d ago Qwen 3.8 35bA3b wen? Artificial analysis index scores Qwen 3.5 27b: 35 Qwen 3.6 27b: 38 Qwen 3.8 27b: 52 What the hell kind of a jump was that? Even if it is benchmaxxed, the jump is insane. Qwen3.6 35b A3b: 32 That's ~6 points behind its dense 27b model, but is ~5x faster for inference given only… 29 Page 9 of 10 · 500 articles ← Newer Older →
