News / #model-release Tag Model releases 500 articles archived under #model-release · RSS Sign in to follow MIT Technology Review — AI news-outlet 5d ago How to encourage smarter AI use in the classroom This article is from Making AI Work, MIT Technology Review’s limited-run newsletter examining how to apply LLMs across industries. To receive it in your inbox, sign up here. Chatbots took many schools by surprise upon their release a few years ago. Suddenly, students carried an… 16 r/LocalLLaMA community 5d ago TielCoder's 22 GB 4-bit quant matches Opus4.6 medium on recent real life coding issues, surpassing KAT-Coder and Nail as strongest and fastest MoE picks. Qwen3.8-27B is amazing, but it’s slow. A stronger 35B-A3B Mixture of Experts-coder that can run and solve real codebase issues fast (even on constrained hardware) is a valuable addition to the arsenal. This one is the strongest and most consistent 35B-A3B I’ve benchmarked, on… 38 r/LocalLLaMA community 5d ago Real local agentic coding on a 12GB VRAM budget. Thanks to Unsloth Dynamic 3.0 quants coming in slightly leaner and better preserved, I settled on Qwen 3.8 27B (`UD_Q4_K_XL`) at 100K context as my daily driver for Hermes Agent and OpenCode. On an RTX 5070 Ti Mobile (12GB) paired with an Intel Core Ultra 9 275HX and 32GB DDR5,… 29 llama.cpp releases dev-tools 5d ago b10610 ggml : shorten virtual device naming in CUDA and Metal ( #27608 ) ggml : shorten virtual device naming in CUDA and Metal Assisted-by: llama.cpp:DeepSeek-V4-Flash-0731 ggml-metal : build device description at init Assisted-by: llama.cpp:DeepSeek-V4-Flash-0731 cont : naming… 22 OpenAI official-blog 6d ago Advancing price-performance for developers with GPT‑5.6 in Kiro GPT‑5.6 is now available in Kiro, helping developers plan, build, review, and test software with better price-performance. 21 r/LocalLLaMA community 6d ago Top 10 most liked models on Qwen's HuggingFace page This shows how Qwen3.8-27B smashed all expectations and in less than a month got more likes than the next 4 models combined, finally surpassing their long reigning queen QwQ-32B. Next best thing is Qwen3.6-35B-A3B (which they have been sleeping on during 3.8 iteration). The… 33 r/LocalLLaMA community 6d ago Qwen 3.8 27B Aider score I ran the Aider benchmark on Qwen 3.8 27B FP8 with FP8 KV cache 256K context vLLM. The score: 72.9 This matches Gemini 2.5 Pro from 2025-04-12 which also scored 72.9. Beats Claude Opus 4 from 2025-05-25 which scored 72.0. DeepSeek R1 2025-06-06 scored 71.4. It may just be a… 24 llama.cpp releases dev-tools 6d ago b10604 Deepseek 4: -sm tensor ( #26490 ) DSV4: sm tensor set coarser granularity for head splits fix dspark add model saving for dsv4 + allow dflash to return on specific device add comment about dsv4 seq_rm simplify add shared expert delayed allreduce remove special test for dsv4… 35 r/LocalLLaMA community 6d ago What are all the things qwen 3.8 27B is NOT good for? What has it gotten worse at or what is it unusable for?   submitted by   /u/Adventurous-Gold6413 [link]   [comments] 21 Smol AI News news-outlet 6d ago not much happened today **Z.ai** released the **GLM-5.3** open-weight model family, optimized for **agentic coding** and **cyber defense**, with impressive specs like **744B total / 40B active parameters**, **1M context window**, and a **239GB 2-bit** variant retaining **81% accuracy**. **Tencent**… 28 Hugging Face Daily Papers research 6d ago Llama-Mobile: Efficient 2.7-Bit Quantization of VLMs Abstract A framework quantizes vision-language models for mobile deployment using self-generated training data and a 2.7-bit format, compressing Llama 3.2 11B Vision Instruct to 3.7 GB with preserved visual question answering performance. Generated by… 17 r/LocalLLaMA community 6d ago deepseek-v4-flash-0731 - surprisingly usable I just finished building my (relatively) low rent local inference machine: * Epyc 7663 * 256GB ECC DDR4-3200 * 1x RTX 5090 32GB Yeah I realize it's weird to throw a 5090 and 256GB of anything together and call it low end, but relative to ~151GB of weights it is. I'm running… 15 arXiv — Machine Learning research 6d ago Nothing Changed but the Model: CellFill -- Bounded In-Cell Learning for Bit-Identical, Revocable Updates to Quantized LLMs arXiv:2608.20873v1 Announce Type: new Abstract: Every way of teaching a deployed language model something new -- full fine-tuning, adapter merging, model editing -- replaces the released checkpoint, and with it every evaluation and cache that referred to those exact bits. We… 13 r/LocalLLaMA community 6d ago Qwen 3.8 27B, just wanted to say thanks to you guys I commented on another Qwen 3.8 27B post that I was frustrated getting anything to work. You all gave some great comments. I nuked openwebui and straightened out my llama.cpp docker config. 1 hour of work and I have a model I can chat with, connected to my HomeAssistant server,… 6 r/LocalLLaMA community 6d ago clean your dust bunnies Qwen 3.5 opus 4.6 distilled said I need to give him some maintenance. Featuring the wolfbox   submitted by   /u/TinFoilHat_69 [link]   [comments] 35 r/LocalLLaMA community 6d ago Qwen 3.8 27b helped me with something unique that Opus 4 couldn't - Firmware + Software preservation and emulation on an early 2000's ARM based POS system Hi all, I made a post regarding how much Qwen 3.8 has improved over 3.6: https://www.reddit.com/r/LocalLLaMA/comments/1vqm51f/long_review_qwen_38_27b_is_very_good_at_tapping/ I made a very thorough write-up of how Qwen 3.8 compared not only to 3.6, but frontier models when it… 5 r/LocalLLaMA community 6d ago We quantized Qwen 3.8 27B and compared the quants on an RTX 6000 Me and my team made Atomic Dynamic GGUF quants for Qwen 3.8 27B, so we wanted to see the difference between them by giving each quant the same voxel island creation task First of all we were surprised at how well Qwen 3.8 27B handled the 3D scenes in general, though part of that… 15 r/LocalLLaMA community 6d ago New qwen3.8:27b on a 39k line C to single-file HTML / three.js port I was just curious how the new qwen3.8:27b does on a hard C to HTML porting job against Opus 5 in a default Claude Code. The job: my fun side project is a procedural shooter in a single C file. Port it to a single-file html / three.js with one bot. One prompt, no follow-ups, no… 31 r/LocalLLaMA community 6d ago Benchmark results: what is the best and fastest engine to run Qwen3.8-27B on macOS WARNING: I think I made a mistake with omlx, and its results below seem to be without any kind of acceleration. I am rerunning them with Lightning MTP and ANE support for prefill. Will update the post once done. The new Qwen 3.8 27B is fantastic for local agentic use. The… 5 r/LocalLLaMA community 6d ago Qwen 3.8 27B for actual local programming Most YouTube benchmarks only show trivial tasks like generating landing pages or simple Three.js games. Is a local model like Qwen 3.8 27B actually capable of real-world systems programming—such as building GTK4 or Qt 6 applications in Rust or C++ with external libraries?… 10 r/LocalLLaMA community 7d ago Qwen3.5-9B Triple-Loop I was fascinated by Nanbeige's outstanding performance for its size, so I started digging into how much a model can improve its own representation just by looping over itself (for fun). My prototype was a Qwen3-0.6B with a full dual loop in the middle layers, inspired by the… 15 r/MachineLearning community 7d ago 28 TPS on Qwen2.5-7B across two separate cloud regions over public WAN using speculative decoding + CUDA Graphs [P] been building ShardFlow for the past few months, a distributed LLM inference framework that splits any HuggingFace transformer across N GPU machines and uses neural speculative decoding to deal with WAN latency. the setup for the benchmark: two T4 nodes in separate GCP regions… 7 r/LocalLLaMA community 7d ago Qwen3.8-27B NVFP4 with vision + 451K token KV-cache on one RTX 5090 (power limited to 400W) at 120 tokens/s average Hello, So I've been trying lots of combinations in that never-ending landscape of options and settings. I wanted a proper quant of 3.8 27B running as fast as possible on my 5090 at 400W, with vision and with as much KV-cache as possible and with concurrency enabled (aiming at 3… 25 r/LocalLLaMA community 7d ago GMKtec is going to launch new hardware with Ryzen AI Max+ PRO 495 at IFA Berlin 2026   submitted by   /u/fairydreaming [link]   [comments] 26 llama.cpp releases dev-tools 7d ago b10593 DeepseekV4: fix rollback with multi-seq ( #26756 ) DeepseekV4: fix rollback with multi-seq fix model loading make pending rollback single use only clear cache for seq_id for full load add assert for compress ratio make graph topology static pass true instead of flags in… 25 r/LocalLLaMA community 7d ago DeepSeek V4 Flash on an M2 Ultra: repacked to 141 GiB losslessly, smaller than the Q4 GGUF, at 25.8 t/s (42 t/s peak) This is one more vibe slopped custom optimization for, in this case, my hardware (m2 ultra 60 cores, 192gb). It is just a fork from llama.cpp with a few changes, it achieves: - DeepSeek V4 Flash, no kv cache quant - 141GiB model, byte-identical lossless, smaller than the public… 13 r/LocalLLaMA community 7d ago Best model you can run on a 16gb phone? Qwen 3.5 9B q6?   submitted by   /u/ikkiyikki [link]   [comments] 26 r/LocalLLaMA community 7d ago Don't want to be this guy, but I need Qwen 3.8 35B A3B Qwen 3.8 27B is great, however it takes me ages to do tasks on xhigh. I need Qwen 3.8 35B A3B. It'll be a little dumber but faster. I am also aware of the fact that 27B gets its "intelligence" from the long thinking time. I therefore assume that 35B would also be a long-thinking… 26 r/LocalLLaMA community 7d ago Qwen3.8-27B KLDs I have been lurking on reddit for like 6 years, and this is the first time posting, so apologies for the mistakes. I'm not a native English speaker, so sorry for the bad English too. I used LLM to translate / refine my post, including images. This is my attempt to compare the… 4 r/LocalLLaMA community 7d ago DeepSeek Harness is Insanely Good I don't know about you guys, but Deep-seek harness is insane. It's not focused on being a coder agent, it's webUI made it very easy to just checkin from time to time, and the best part? Why it's better than Hermes? It wasn't frustrating at all to setup. ZERO. NADA. Progressive… 14 r/LocalLLaMA community 7d ago Best harness for Qwen 3.8 27b ? I’ve tried Open Code , Codex and Qwen Code and so far Qwen Code seems to work the best for me , the only complaint I have about it is that the CLI interface is a bit rough / sloppy .   submitted by   /u/HelloWorld-Print [link]   [comments] 35 r/LocalLLaMA community 7d ago Qwen 3.8 27B is a game changer. Our devs got their hands on it a few days ago. One wired it into Codex to compare with GPT Luna, our usual workhorse right now for its cost effectiveness. Another tried it out on one of our OCR pipelines. It's comparable to Luna for coding and ***OCR quality appears to be better… 18 r/LocalLLaMA community 7d ago # Qwen3.8-27B — One Week Later: The r/LocalLLaMA + r/LocalLLM Verdict Companion to the Qwen 3.8 Release Megathread . Compiled from ~2,000 posts scanned across both subs, with deep reads of the 45 highest-signal threads (560 posts and comments), Aug 15–22, 2026, plus independent X benchmarks. Every number is attributed to the poster's stated… 16 r/LocalLLaMA community 7d ago Closed AI has been real quiet since Qwen 3.8 27B dropped. This is something I've noticed. Back when GLM 5.2 and Kimi K3 launched, there was a media push on pushing how dangerous open source models are. We know why they were doing this; these open models are good enough to devalue paid closed models. I think the fear mongering was to… 16 r/LocalLLaMA community 7d ago Has anyone actually made 64k feel like 300k+ with recursive local agents? I'm running Qwen 3.8 27B locally on a single GPU. I can push the context to 131k, but I'd rather run it faster at 64k if the agent can manage context properly. What I have in mind is pretty simple: one model stays loaded the whole time main agent gets 64k when something is too… 32 r/LocalLLaMA community 7d ago Tested in Coding: Q8_K_XL Qwen3.8 27B vs BF16 Qwen3.6 27B Further to my last post, https://www.reddit.com/r/LocalLLaMA/comments/1vldngi/tested_in_coding_bf16_muse_glimmer_vs_bf16_qwen36/ , I bring this requested comparison of Qwen3.8 27B. Context: Both models are running at full FP16 KV-cache. Due to RAM limitations, BF16 Qwen3.6 was… 23 r/LocalLLaMA community 7d ago Best harness for long autonomous tasks I read a lot of posts like "I've given this prompt to my Qwen 3.8 27b and it one-shotted me a 3d game after 24 hours". I wonder, what's the best harness for tasks like this? It has to have auto compaction and probably a memory system, right? And excellent computer use and self… 37 r/LocalLLaMA community 7d ago 3 experiments running dsv4-flash-0731 q4+ quants on 128GB RAM + ~60 GB VRAM (with a quite bad pcie infra) with an acceptable tgs and relatively acceptable pp speed The post describes some experiments I had while trying to desperately run deepseek-v4-flash-0731 4 bit+ quants on my machine which is supposed to support only q2 quants of the model, a or 2.xx bpw quants at best. Long story short , I wanted to have my tgs in the high twenties… 30 r/LocalLLaMA community 7d ago I benchmark DFlash 2 (PR build) in llama.cpp on Qwen 3.8 27B against all speculative methods for 3 days. 2.26x on 100 real coding prompts, 4.68x with one n-gram drafter on top. Up to 8x on specific cases. Hey guys, Inco AI shipped DFlash 2 a few days ago with a drafter for Qwen 3.8 27B and a llama.cpp PR. I built the PR and ran it against plain decoding, MTP, the n-gram lookup drafters, and my July DFlash 1 numbers on Qwen 3.6 27B for 3 days. One RTX PRO 6000, concurrency 1,… 26 r/LocalLLaMA community 7d ago Single RTX 5090: Qwen3.8-27B NVFP4 at a real 262K context in vLLM — 77 tok/s short-context, 64.7 tok/s at 128K This is the Qwen3.8-27B setup I actually use every day on one RTX 5090. I wanted to write it down with enough detail that another 5090 owner can reproduce it instead of guessing which memory knobs I used. The short version: the full 262,144-token window fits together with… 25 TechCrunch — AI news-outlet 7d ago Inherent, founded by DeepMind alumni, says its AI ‘teammate’ just outperformed Anthropic and OpenAI at replicating research Built by DeepMind alumni, British AI lab Inherent released Faraday, an AI agent whose ability to replicate scientific papers could be a stepping stone for innovation. 32 r/LocalLLaMA community 7d ago Watching that wattage, in your terminal. Released today: version 1.3 of energygraph Zero build dependencies, lightweight tool for live views of the power-consumption. Version 1.3 adds support for dGPUs from nvidia, intel, amd. Depending on vendor support, you can also get the consumption by your cpu cores, iGPU,… 4 r/LocalLLaMA community 7d ago I forked Ninfer 3090 and converted it to run on the CMP170HX - doubled my Qwen3.6-35B from llama.cpp Good afternoon, everyone! I wanted to show the work I've been doing around porting Ninfer over to the CMP170HX ( Github ) So, first, I do want to call out the amazing work that Neroued , Sergiuszm and specifically Don-Chad have all done, to not take away from vLLM, Llama.cpp and… 37 Simon Willison community 7d ago llm 0.33 Release: llm 0.33 My highlights from this release: Upgraded to the OpenAI Python library 3.x and switched the HTTP client dependency from httpx to httpx2 . #1608 , #1631 I shipped a quick 0.32.1 fix for this yesterday, but this is the more comprehensive fix. llm embed and llm… 38 r/LocalLLaMA community 8d ago Qwen 3.5 4B IQ2_XS: +16.67% Reasoning Performance From Tensor-Level Allocation I was finally able to replicate tensor level allocation outside the Gemma family. https://huggingface.co/ByteOtter/Qwen3.5-4B-CADA-IQ2_XS After the Gemma 4 12b, e4b and gemma 3 4b results, I attempted to expand into qwen and ran into a few walls. After 2 version updates and a… 4 r/LocalLLaMA community 8d ago web_search tool in deepseek harness needs api key from deepseek and deepseek charges you as deepseek-v4-flash usage. I was experimenting with deepseek harness when found that even if you don't use deepseek models, you can configure the web_search tool with their api key and every hit will cost you as if you called deepseek-v4-flash model. It's a bummer. on top of that there is currently no… 38 Ahead of AI (Sebastian Raschka) research 8d ago How Claude Watermarks AI-Generated Text A 48-minute video walkthrough of token sampling, watermark detection, and removal 9 r/LocalLLaMA community 8d ago Artificial Analysis "Intelligence": A meaningless benchmark https://preview.redd.it/84zi5nsdawkh1.png?width=2368&format=png&auto=webp&s=1109e69db807b153064b1f5b61d22cf1e9fbca05 Another user posted the benchmarks for Qwen 3.8 27B today, and while I think Qwen 27B is a really powerful model, I can't help but notice just how meaningless… 34 r/LocalLLaMA community 8d ago Need support for llama.cpp with multi GPU Using llama.cpp I seem to be unable to get my to GPUs working tougether correclty, so I need help somehow. Setup: 96GB RAM, one Blackwell 5000 (48GB) and one 3090 (24GB). I am trying to run the UD-Q3_K_XL quant of Deepseek4 flash which has about 120GB size. Using just the… 20 r/LocalLLaMA community 8d ago AntLing released a dspark draft model for Ling-3.0-flash No GGUFs yet on Huggingface though.   submitted by   /u/Ihtien [link]   [comments] 8 Page 5 of 10 · 500 articles ← Newer Older →
