News / #model-release Tag Model releases 500 articles archived under #model-release · RSS Sign in to follow r/LocalLLaMA community 8d ago Mistral CEO says new AI model beats Chinese ones in some areas   submitted by   /u/tengo_harambe [link]   [comments] 17 r/LocalLLaMA community 8d ago ComfyUI v0.39.0 released   submitted by   /u/Fcking_Chuck [link]   [comments] 25 llama.cpp releases dev-tools 8d ago b11440 llama : re-reserve the sched when the nextn extraction flags change (… 14 llama.cpp releases dev-tools 8d ago b11439: ggml: refactor selective expert copying to user code (#29943) ggml: refactor selective expert copying to user code tests: enroll two models into selective expert copy test tests: use deepseek2 as test model improve comment in ggml-backend.h Co-authored-by: Georgi Gerganov ggerganov@gmail.com cont: fix whitespace cont : better comments… 31 r/LocalLLaMA community 8d ago unsloth/Qwen3.8-Flash-Next-GGUF is being updated Looks like Unsloth is updating https://huggingface.co/unsloth/Qwen3.8-Flash-Next-GGUF to work with llama.cpp, so hopefully this will resolve the issue of having two different GGUF versions of Qwen Flash Next.   submitted by   /u/jacek2023 [link]   [comments] 26 Ollama releases dev-tools 8d ago v0.40.0 What's Changed Models run on MLX on Apple Silicon by default In this release, on Apple Silicon devices, model architectures supported by the MLX runtime will automatically run on MLX. ollama pull qwen3.8 ollama run qwen3.8 Additional models include gemma4 , qwen3.6 and qwen3.5… 23 r/LocalLLaMA community 8d ago Qwen 3.8 27b just feels… ok? I’ve seen posts here raving about how good Qwen 3.8 27b is. The benchmarks look incredible, and all the online discourse seems to deem it the best local model. I have 32GB VRAM and run Unsloth’s Q6 version with OpenCode. For small tasks, it feels fine. I range 30-40 t/s decode… 15 Vercel — AI dev-tools 9d ago Mistral Large 4 now available on AI Gateway Mistral Large 4 is now available on AI Gateway. The open-weight, natively multimodal model combines reasoning with text and image understanding. It is useful for cyber defense, manufacturing, and finance workflows. You can access the model through AI Gateway with one API key,… 8 Vercel — AI dev-tools 9d ago Nano Banana 2.1 now available on AI Gateway Nano Banana 2.1 from Google is now available on AI Gateway . It improves image generation and editing over earlier Nano Banana models. This release targets product recontextualization, mask- and ink-based editing, and factuality. Product recontextualization places an existing… 34 r/LocalLLaMA community 9d ago A benchmark for LLMs playing Civilization V. GLM-5.3 is ahead of Opus-5.5, and Qwen-3.8-27B holds up surprisingly well. A while ago, I posted here getting OSS-120B and GLM-4.6 playing full games of Civilization V . Since then, models have moved pretty far, and we wanted a better understanding about models' capabilities playing the game. Introducing the controlled version of CivBench on newer… 14 Hacker News — AI on Front Page community 9d ago Example.com just launched the biggest redesign in decades Article URL: https://www.debugbear.com/blog/example-dot-com-redesign-history Comments URL: https://news.ycombinator.com/item?id=49971921 Points: 205 # Comments: 122 18 Hacker News — AI on Front Page community 9d ago ChatGPT is adding real cartoonists' signatures to fake New Yorker cartoons Article URL: https://www.niemanlab.org/2026/10/chatgpt-is-adding-real-cartoonists-signatures-to-fake-new-yorker-cartoons/ Comments URL: https://news.ycombinator.com/item?id=49971846 Points: 240 # Comments: 134 11 The Information — AI news-outlet 9d ago Aligning AI With Human Goals Might Be Impossible, Says AI Prof. Stuart Russell Last week, OpenAI scrapped the model it had slated to release as GPT-6.1 Astra due to test results showing that it was deceptive and otherwise misaligned. “I think it’s about time,” said Stuart Russell, the computer science professor at the University of California, Berkeley,… 24 Hacker News — AI on Front Page community 9d ago Opus 5.5 agents discover two room-temperature magnetic semiconductor candidates Article URL: https://www.vals.ai/blogs/room-temperature-magnetic-semiconductors Comments URL: https://news.ycombinator.com/item?id=49970667 Points: 211 # Comments: 163 9 r/LocalLLaMA community 9d ago When Redditors come in here and ask why we run LLMs, this is why: Big AI is watching. Anthropic Reports Florida Woman's Claude 'Diary' Threat to Law Enforcement And this time it wasn't the AI model that made the LEO referral. It was the "human review team". The frontier AI companies are watching your input. And people say "Well I'm not interesting or important… 15 Hacker News — AI on Front Page community 9d ago Beam: Reflection's 501B open-weight model Article URL: https://reflection.ai/blog/introducing-beam Comments URL: https://news.ycombinator.com/item?id=49969183 Points: 231 # Comments: 63 6 r/LocalLLaMA community 9d ago llama.cpp v0.6.0 released with MTP speculative decoding for Qwen4Exp and lots more   submitted by   /u/vexatious-big [link]   [comments] 12 TechCrunch — AI news-outlet 9d ago Instinct brings its AI agent to group chats, even for friends without an account Instinct is launching group chats that let friends use its AI agent together for tasks like planning trips, organizing carpools, and coordinating events. The company says personal accounts remain separate, with permission required before personal agents share information or take… 24 The Information — AI news-outlet 9d ago Meta and Microsoft Work to Wean Staff Off Anthropic’s Claude Meta Platforms and Microsoft , two of Anthropic ’s biggest corporate customers, are working to cut their employees’ use of Claude, a challenge for the AI firm’s efforts to sustain its explosive growth. Microsoft executives earlier this year projected that the company was on… 20 r/LocalLLaMA community 9d ago How is it possible that qwen 27b is so good? When GPT 4o had a trillion parameters and was worse? Picture from a post in r/amodei . People were praising qwen and I'm just wondering, what kind of new technologies are at play here? Does qwen just have "better" pre training data? That's more high quality?   submitted by   /u/SignificantZebra5883 [link]   [comments] 13 TechCrunch — AI news-outlet 9d ago HackerRank’s AI interviewer offers a glimpse into what job interviews could become HackerRank’s AI interviewer has already conducted more than 500,000 interviews, with Snowflake, Snorkel, and Capgemini among its early testers. 36 GitHub Blog — AI & ML official-blog 9d ago ReviewBench: An open benchmark for AI code review We’re launching ReviewBench, a benchmark for code review agents built on representative GitHub pull requests, multi-source ground truth, calibrated evaluation, and production-aligned metrics. The post ReviewBench: An open benchmark for AI code review appeared first on The GitHub… 22 r/LocalLLaMA community 9d ago Speakrail - a low-latency fully-local voice assistant that runs on a single RTX 4090 tl;dr: I created a fully-local open-source full-duplex voice agent that rivals GPT-Live on some benchmarks. It uses Voxtral Realtime with a turn-taking head, a microturn-finetuned Gemma 4 12B and Breeze TTS 2 under the hood. Go try it out: https://github.com/speakrail/speakrail… 21 r/LocalLLaMA community 9d ago Finetuned 1.5B Qwen to generate bash commands at gpt-4o level using 400k synthetic examples + Fully opensource finetune dataset Purely a hobby side project to see how far I can push a really small model, using (mostly) automated training pipelines Full synthetic data: https://huggingface.co/datasets/dirac-run/ec-training-data Models: https://huggingface.co/dirac-run/ec-1.5b-gguf and… 15 r/LocalLLaMA community 9d ago Qwen3.8-Flash-Next (125B) on a single Strix Halo mini PC: 44-59 tok/s with speculative decoding, ~1,400 tok/s prefill, engine is open Hey all. We've spent the last weeks getting Qwen3.8-Flash-Next (125B MoE, 6B active) to run properly on one AMD Strix Halo box (Ryzen AI Max+ 395, 128 GB). Tonight we're releasing both the 95 GB EXL3 weights and a new version of Kyojin, our inference engine (built on ExLlamaV3,… 9 r/LocalLLaMA community 9d ago Qwen3.8-27b appreciation moment q3.8-27b q3_k_xl this thing have done everything i possibly needed from him he wired up my openwebui spawned trillium service fix all my bugs set up pi-web-ui and debug my cloudflare tunnel it even spawned smaller LLMs to make the LLM use the toole he created to ensure it will… 20 TechCrunch — AI news-outlet 9d ago OpenAI launches visual ads that appear alongside image generation results OpenAI said the new visual ads will show up after your image generation results appear in the U.S. only for now. 8 r/LocalLLaMA community 9d ago I built an open-source real-time Japanese anime subtitle & translation engine powered by Whisper-Large-v3 + Groq / DeepSeek Hey r/LocalLLaMA , Like many anime fans, I've always been frustrated by traditional MT engines (like Google Translate or base DeepL) when dealing with raw Japanese anime: - They completely butcher Japanese honorifics, sentence-ending particles ( -tteba , -zo , -desu wa ), and… 25 Don't Worry About the Vase community 9d ago Mythos 5.1, Fable 5.1 and Opus 5.5: Model Welfare If you are familiar with my previous posts on model welfare for new Claude models, you can skip the Introduction and The Story So Far. 18 r/MachineLearning community 9d ago Language barrier, shadier terms and jargon fog [D] Hey all, I don't know if you guys are experiencing the same thing, but there is this behaviour that i have been noticing on the latest models on openAI (since sol 5.6) and Anthropic since Fable 5.1 and opus 5.5 .. Basically the models use more "complexe" terms and words, not… 6 r/LocalLLaMA community 9d ago Agens Volundr 32B Preview: our small team's first model on our own hybrid architecture. Only 18 of 72 layers keep a KV cache (Apache-2.0) Hi r/LocalLLaMA . I'm on the team at Blockway, a small team in Hong Kong (disclosure: this is our model). Today we released Agens Volundr 32B Preview, the first model built on our own hybrid architecture. We trained it on limited compute, it isn't perfect, and we'd rather tell… 5 llama.cpp releases dev-tools 9d ago b11414 vulkan: fix stale prealloc_y reuse across flash attention and soft_max ( #29591 ) Assisted-by: Claude Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/52808438 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI… 28 Hacker News — AI on Front Page community 9d ago Mold Linker Version 3.0.0 Release – Rewritten in Rust Article URL: https://github.com/rui314/mold/releases/tag/v3.0.0 Comments URL: https://news.ycombinator.com/item?id=49963385 Points: 212 # Comments: 124 19 r/LocalLLaMA community 9d ago MoE SSD streaming on a 64 GB Mac mini: GPU still waits 27% of decode on experts. Ideas? Looking for some assistance /ideation. I am running qwen flash next q4 in my Mac mini m5 64gb. QFN doesn’t fit so this is done by having as many experts hot in cache as possible and streaming in the rest from ssd. I’m getting 17.5 tks decode and 390 tks pp. Have done a bunch of… 32 Hacker News — AI on Front Page community 9d ago Web Search API Article URL: https://developers.cloudflare.com/changelog/post/2026-10-02-introducing-web-search-api/ Comments URL: https://news.ycombinator.com/item?id=49963171 Points: 406 # Comments: 195 24 llama.cpp releases dev-tools 9d ago b11412 llama : fix unexpected graph reallocation in the k-pool models ( #29958 ) llama : fix unexpected graph reallocation in the k-pool models Both k-pool models built a graph shape that depends on state the full-context reserve cannot know: qwen4exp branched on inp->cache_safe, which… 7 llama.cpp releases dev-tools 9d ago b11413: vulkan: sparse flash attention for quantized K/V (#29639) vulkan: sparse flash attention for quantized K/V Assisted-by: Claude vulkan: single-scan sparse FA index compaction The compaction ran one workgroup per mask row and walked the row in BLOCK_SIZE chunks, with a workgroup scan per chunk. For decode that is one workgroup doing… 19 r/LocalLLaMA community 9d ago Switched my local agent from Qwen3.8 27B to Ornith 1.5 35B-A3B on two 5070 Tis: about 180 tok/s vs 60, same scores on my tests My setup is two RTX 5070 Ti 16GB cards (the second one is on an OCuLink dock) with 64GB of RAM, Ollama on Windows, and the agent runs on pi in WSL. Until last night the daily model was Qwen3.8 27B UD-Q4_K_XL at 128K with MTP, which does about 55 to 70 tok/s across both cards. I… 24 r/LocalLLaMA community 9d ago I got Qwen Flash Next Q4 running on a Mac Mini m5 64gb with ssd streaming Bit of a side project I wanted to share. The metrics are 17.5tks decode, 360tks prompt processing based testing against my normal ai usage. I tested a couple of new things others haven’t done (at least that I’ve seen). Setup a carousel buffer for streaming in experts for prompt… 25 r/LocalLLaMA community 9d ago Reflection AI Is About to Release a US Open-Weight Model to Take On DeepSeek and Qwen Looks like new open model coming soon and will be "strong" hopefully something under 200b for us memory poor. Also seeing statements about more western open models coming. Hope we get some good competition again on the open front! Here is original artical but its not free to… 4 arXiv — Machine Learning research 9d ago Differential Privacy of Gradient Descent on Perturbed Objectives arXiv:2610.02716v1 Announce Type: new Abstract: Objective perturbation adds a random linear term to a regularized empirical risk and releases the exact perturbed minimizer. We study the finite computation obtained by releasing the $N$-th iterate of deterministic gradient descent… 14 arXiv — NLP / Computation & Language research 9d ago HakemBench: A Turkish Benchmark of Typed Decisions arXiv:2610.02293v1 Announce Type: new Abstract: HakemBench is a Turkish benchmark of typed decisions, in which the model under test reads a text, a question and a fixed set of options and returns a probability for every option. Version 1.0 is released fully open under CC BY 4.0,… 38 arXiv — NLP / Computation & Language research 9d ago Personalized Automatic Speech Recognition for a Dysarthric and Tracheostomic Speaker using Artificial Conversations arXiv:2610.03017v1 Announce Type: cross Abstract: This work presents an automatic speech recognition (ASR) system personalized for a Czech speaker with a permanent tracheal stoma and severe dysarthria rendering their speech unintelligible to untrained listeners. We release a… 29 r/LocalLLaMA community 9d ago Infermeld: a Linux kit for running one GGUF across AMD + NVIDIA GPUs with llama.cpp Following on from club-5060ti and club-rdna16 , I’ve put together Infermeld : a small, open-source Linux companion kit for running one GGUF across an AMD GPU and an NVIDIA GPU, powered by llama.cpp. I’m the maintainer. This is an experimental v0.1.0 release , and I’m looking for… 24 r/LocalLLaMA community 9d ago strata-swift-iq3_xxs randomly interjecting completely unrelated information in thoughts I have been using Qwen3.8-27b-iq4xs variants for the past few weeks, tweaking parameters and running random tasks, but I dove into using https://github.com/Niko1221/Strata today and it has given me 2~3x performance on a "smarter" strata-swift-iq3_xxs model with my 5070ti!… 6 r/LocalLLaMA community 9d ago My qwen model hallucinated a signed URL to Alibaba cloud, normal or sketchy? I'm using Qwen3.8-Flash-Next running on my Mac Studio as a daily driver for coding + productivity tasks, and yesterday it did something weird: I had it do some product research on amazon, so it was doing a lot of Web tool calls to amazon.com , until it made one request to… 34 Vercel — AI dev-tools 10d ago OpenAI Ultrafast mode now available on AI Gateway AI Gateway now supports OpenAI's Ultrafast service tier for GPT-6 Astra, providing faster output for interactive applications and rapid coding iterations. To use Ultrafast, request it for openai/gpt-6-astra through AI SDK, the Chat Completions API, or Responses API: For… 28 Vercel — AI dev-tools 10d ago FLUX 3 Image now available on AI Gateway FLUX 3 Image from Black Forest Labs is now available on AI Gateway. Generate images from text or edit existing images using the same model, with one API key and no Black Forest Labs account required. FLUX 3 Image supports up to ten reference images for editing, combining… 35 Ollama releases dev-tools 10d ago v0.40.0 What's Changed Models run on MLX on Apple Silicon by default In this release, on Apple Silicon devices, model architectures supported by the MLX runtime will automatically run on MLX. ollama pull qwen3.8 ollama run qwen3.8 Additional models include gemma4 , qwen3.6 and qwen3.5… 11 r/LocalLLaMA community 10d ago Upgrading from 1xR9700 to 2xR9700. Thoughts on build before buying? Currently have a R9700 build with 64GB RAM. Want to get a second one for both speed and the ability to run Qwen3.8-Flash-Next at Q4/higher quants of 3.8 27B. Looking for thoughts or any improvements before buying the rest of the parts. Made sure to get a motherboard that… 23 Page 7 of 10 · 500 articles ← Newer Older →
