News / #model-release Tag Model releases 500 articles archived under #model-release · RSS Sign in to follow arXiv — Machine Learning research 10d ago ProxyGuard: Direct Reliability Inference for Randomized Data Release Mechanisms with Shared Targets arXiv:2608.18643v1 Announce Type: new Abstract: Researchers often choose a proxy dataset from many releases, transformations, or seeds. Search can make an invalid release appear adequate, while one adequate release does not establish that its generator is reliable. ProxyGuard… 26 arXiv — NLP / Computation & Language research 10d ago Decomposing Wrong-Consensus Agreement in LLM Self-Consistency: A GPT-4.1 Case Study arXiv:2608.18795v1 Announce Type: new Abstract: Majority voting over multiple LLM samples is widely used to raise answer accuracy, yet its gain varies erratically: on hard questions it can even backfire. This paper gives a quantitative account of this failure. A pluralistic… 26 arXiv — NLP / Computation & Language research 10d ago Introducing the Privacy-HSD Trade-off: Hate Speech Detection, but not at the Cost of Privacy arXiv:2608.19006v1 Announce Type: new Abstract: Hate speech is a real and timely threat that affects a large portion of online users, especially youth and minority groups. While building reliable and robust automatic hate speech detection (HSD) systems is paramount, we argue… 24 arXiv — NLP / Computation & Language research 10d ago Institutional Books - Enriched Text: A customizable multilingual open-source pipeline for denoising, deduplicating, and annotating OCR text at scale arXiv:2608.19026v1 Announce Type: new Abstract: Released in 2025, Institutional Books: Harvard Library (IB-HL) is a collection of 983,004 volumes (242B o200k_base tokens), originally digitized through Harvard Library's participation in the Google Books Library project. As… 17 arXiv — NLP / Computation & Language research 10d ago What is Missing from AI Post-Training AI: An Empirical Analysis arXiv:2608.19072v1 Announce Type: cross Abstract: Large language model (LLM) agents can now post-train an LLM end-to-end. They can write code, launch training, evaluate checkpoints, and improve downstream performance, raising the prospect of AI-for-AI. We argue that this picture… 13 r/LocalLLaMA community 10d ago Qwen3.8-27B took a serious hit to *knowledge* vs 3.6 Like many of you I've spent the last few days throwing Qwen3.8-27B against all of my usual use-cases and personal tasks/harnesses and workflows. It's great, phenomenal sometimes, but that's not what this post is about. One of my little personal benchmarks is a little set of… 10 r/LocalLLaMA community 10d ago Qwen3.8-27b has the highest level of "agency" I've ever seen in a local model Off a single prompt, given my credentials and the name of my university, qwen3.8-27b was able to successfully pull my class schedule from the kinda shitty and convoluted web of university websites. It needed no human intervention, and executed 80 tool calls. Another time, I… 28 OpenAI official-blog 10d ago How ChatGPT Work helps Stampli move ideas to market With a fixed deadline and design resources committed elsewhere, Stampli used Codex and ChatGPT Work to compress weeks of launch production into days. 7 Vercel — AI dev-tools 10d ago Bun 1.4 is now available in Vercel Functions Vercel Functions now support the new Bun 1.4 release , a rewrite of Bun from Zig to Rust, with over 2,900 issues resolved, more than 1,500 additional Node.js compatibility tests passing, and new features and performance improvements. Bun on Vercel Functions: Runs on Fluid… 37 Vercel — AI dev-tools 10d ago Vercel Agent is now available in Slack code channels Vercel Agent now works in Slack code channels, a new kind of channel launched today for working with a coding agent. Anyone in the channel can follow the work, give Agent new instructions, and review the code it writes. Choose Create a code channel from the Slack sidebar, select… 38 r/LocalLLaMA community 10d ago Qwen3.8-23B-Mini-Me: A Depth-Pruned Qwen3.8-27B (to ~22.7BB) I've been working on a depth pruning approach and decided to try it out on the new Qwen3.8-27B model. I managed to get the model down to about 22.7B params without severe reasoning degradation. No fine-tuning was done, just strategic removal of layers. It's been working well for… 13 Simon Willison community 10d ago smolmachines / smolvm as a sandbox for untrusted Python & JavaScript Research: smolmachines / smolvm as a sandbox for untrusted Python & JavaScript I tasked Claude Fable 5 running in Claude Code for web with the following research task: Put https://smolmachines.com through its paces as a fast secure sandbox. Explore what it would take to use this… 17 r/LocalLLaMA community 10d ago Qwen 3.8 27B SlopCodeBench results Howdy, I'm back again - running my favorite benchmark (it's still unsaturated for the time being so might as well!) previous runs a b https://github.com/michaelasper/benchmarks/blob/main/qwen3.8-27b-pi-on-slop-code-bench.md I ran this via OpenRouter because my mac would cry… 10 LangChain releases dev-tools 10d ago langchain-openai==1.6.0 Changes since langchain-openai==1.5.2 release(openai): 1.6.0 ( #39762 ) feat(core): add standard model exception types ( #39538 ) fix(openai): raise clear error on unexpected response type in _create_chat_result ( #39731 ) 31 LangChain releases dev-tools 10d ago langchain-anthropic==1.6.0 Changes since langchain-anthropic==1.5.6 release(anthropic): 1.6.0 ( #39763 ) feat(core): add standard model exception types ( #39538 ) fix(anthropic): exclude sibling directories from grep search scope ( #39681 ) chore(infra): support langsmith gateway in CI ( #39651 ) 24 r/LocalLLaMA community 10d ago Fluid Simulation Qwen3.8 27B IQ3_XXS After reading this tweet: https://x.com/scaling01/status/2089784644400976254 where the author says Qwen3.8 27B is not comparable to Opus, I had to try it out myself. First of: GPT 5.6 Sol (High) also failed the task and gave me a blank screen on the first try. And the author… 7 r/LocalLLaMA community 10d ago I pushed Qwen3.8-27B limits again... Dflash2 - 134 tps on a RTX 3090 Edit: Title says 134 tps, it's actually 138 -- keep in mind my 3090 is power limited to 250w. Three days ago I released a hyper-optimized Qwen3.8-27B inference engine for an RTX 3090 (82 tps single request, 672 peak), and yesterday's update took it to ~114 tps single-user /… 30 TechCrunch — AI news-outlet 10d ago Google launches new study tools for Students across Search and Gemini The launch of the new study features marks Google's latest effort to make Gemini the AI assistant that students turn to when learning and studying, as it continues to compete with companies like OpenAI. 12 r/LocalLLaMA community 10d ago Reverse-Engineering the RK3588 NPU: Building an Open Compiler to Run GPT-2 at 36 tok/s Last year I posted about hacking the RK3588 NPU to run one vision encoder ( previous post ). This year I opened the whole thing up: reverse-engineered the register format, built an open compiler + runtime, and now GPT-2 and SigLIP run from PyTorch, ONNX, and JAX, no vendor SDK.… 30 r/LocalLLaMA community 10d ago DFlash2 speeds Qwen 3.8 27B up to 4 times llama.cpp pr #27342 adds dflash2, so i rented an rtx 6000 and ran the same four prompts through four decoding setups on qwen3.8 27B median results over the four tasks: baseline 47.4 tok/s mtp 114.7 tok/s dflash 99.3 tok/s dflash2 140.6. tok/s so on average 3x for dflash2 though… 33 r/LocalLLaMA community 10d ago I might have found the perfect config parameters for qwen 3.8 27b Hello everyone, tried so hard to optimize my config and finally I simply get up to 70 t/s with q6 variant. And wanted to share with you guys so that other people with the same setup can enjoy. Please check out and see if that improves your performance in any kind of way. Also… 15 The Information — AI news-outlet 11d ago OpenAI to Launch Security Analysis System With Better Privacy Protections OpenAI is preparing to roll out a system to analyze user interactions with its models for cybersecurity and other safety concerns without storing customer data, in a move that positions the company to potentially lure customers frustrated over how Anthropic has handled similar… 14 r/LocalLLaMA community 11d ago Introducing Qwen3.8-27B Dynamic v3 Unsloth GGUFs Hey everyone! We’re releasing new Qwen3.8-27B GGUFs with 10% higher accuracy for the same size. This uses a new version of Dynamic v3.0 Unsloth Dynamic V3 outperforms others by >10% on Div-300, KLD & more benchmarks. We also release 1-bit quants that retain 77% accuracy. Run on… 34 LangChain releases dev-tools 11d ago langchain-core==1.6.0 Changes since langchain-core==1.5.6 release(core): 1.6.0 ( #39760 ) fix(core): resolve postponed annotations in StructuredTool._injected_args_keys ( #39602 ) feat(core): add standard model exception types ( #39538 ) fix(core): allow deserializing RunnablePick ( #39753 )… 24 r/LocalLLaMA community 11d ago NVFP4 on VOLTA! Despite being built for Blackwell, I made four 2017 V100s run Qwen 3.8 NVFP4 natively and match my $6000 RTX 5090. Four Tesla V100s from 2017 matched my RTX 5090 on single-request Qwen 3.8 decode. Repo: https://github.com/dnv2003/v100-skinny https://i.redd.it/5ws2ak3uqckh1.gif The 5090 was not being held back. It ran NInfer , a specialist engine built to make this exact model as fast as… 29 r/LocalLLaMA community 11d ago Ornith-1.5 (397B [DeepSWE 56], 35B-A3B, 9B) Aloha! 🌺Introducing Ornith-1.5, a family of open-source LLMs spanning 9B Dense, 35B MoE, and 397B MoE, trained with self-improving strategies. It achieves state-of-the-art performance among open-source models of comparable size and delivers performance comparable to Claude Opus… 28 r/MachineLearning community 11d ago Same effective batch does not mean same training time with gradient accumulation, tested on LoRA on T4 and L4 [D] I had assumed 1 × 4 , 2 × 2 and 4 × 1 will take somewhat similar time because effective batch is 4 in all cases. They did not. I ran Qwen3-1.7B with TRL and LoRA for 100 optimizer updates. GPU 1 × 4 2 × 2 4 × 1 T4 287.6s 258.8s 238.2s L4 213.02s 119.47s 124.76s Model, data,… 34 r/LocalLLaMA community 11d ago We have Q3.8 35B at home: 3x new Ornith 1.5 released Anyone tried them yet? https://huggingface.co/ornith-ai/Ornith-1.5-9B https://huggingface.co/ornith-ai/Ornith-1.5-35B-A3B https://huggingface.co/ornith-ai/Ornith-1.5-397B https://huggingface.co/ornith-ai/Ornith-1.5-9B-GGUF https://huggingface.co/ornith-ai/Ornith-1.5-35B-A3B-GGUF… 9 Hugging Face official-blog 11d ago LFM2.5 Q4\_0 Checkpoints from Quantization-Aware Distillation Back to Articles a]:hidden"> LFM2.5 Q4_0 Checkpoints from Quantization-Aware Distillation Team Article Published August 19, 2026 Upvote - Aditya Tadimeti adityatadimeti LiquidAI Leonie Monigatti iamleonie LiquidAI Today, we release QAD Q4_0 GGUFs. These are updated 4-bit… 10 llama.cpp releases dev-tools 11d ago b10502 ci : add attestation for signed release artifacts ( #25933 ) Website: https://llama.app macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED macOS Intel (x64) iOS XCFramework Linux: Ubuntu x64 (CPU) Ubuntu arm64 (CPU) Ubuntu s390x (CPU)… 21 r/LocalLLaMA community 11d ago updated unsloth/Qwen3.8-27B-GGUF · Hugging Face looks like GGUF files were just updated   submitted by   /u/jacek2023 [link]   [comments] 34 r/LocalLLaMA community 11d ago [Open PR] llama : add --n-cpu-ffn option by John-194 · Pull Request #26622 · ggml-org/llama.cpp PR by u/Stainless-Bacon 👍 It would be handy & awesome to have options --n-cpu-ffn / --cpu-ffn for Dense models like how we have --n-cpu-moe / --cpu-moe for MOE models . Also check his threads: On PR : llama.cpp CPU offload optimizations On Running Qwen3.8-27B with above… 18 r/LocalLLaMA community 11d ago Stop Anthropomorphisizing Intermediate Tokens: Qwen3.8 doesn't "overthink" Intermediate tokens, called "thinking" or "reasoning" actually are nothing like it. Humans do step-by-step reasoning leading to the conclusion. LLMs use intermediate traces to augment their prompt . This explains why sometimes the answer is very good but the "reasoning" is… 21 r/LocalLLaMA community 11d ago Am I doing something wrong? Qwen 3.8 27B seems useless for agentic coding I have been using local models on/off for like 2 years or so but never really used them extensively because the closed ones were always much better. Once Qwen 3.8 27B was released I decided to give it another serious try. I configured Cline and ZooCode as VSCode addons,… 29 r/LocalLLaMA community 11d ago Thoughts About Scaling Law - Z.ai Thoughts About Scaling Law Scaling, but not only of parameters. Every model release now ends with the same question: how many parameters? It isn't a question that can be answered on its own. Parameter count is only meaningful alongside three others — how much data you have,… 14 OpenAI official-blog 11d ago Replit expands access to software creation with GPT-5.6 Luna Replit introduces Free Mode, powered by GPT-5.6 Luna, so anyone can turn ideas into working software without worrying about token costs. 29 Smol AI News news-outlet 11d ago not much happened today **Ornith-1.5** launches as a new open-weight model family with **9B dense, 35B MoE, and 397B MoE** variants under **MIT license**, featuring quantized formats like **FP8, GGUF, MLX, and NVFP4** and showcasing end-to-end **self-improvement** capabilities. Compression techniques… 14 r/LocalLLaMA community 11d ago Qwen3.8-27B on 2x 3090 + vLLM + DFlash2: 218 tok/s single request I hacked this together so there's probably more on the table in terms of performance. Measured with the Club-3090 canonical bench suite (bench.sh, 3 warmups + 5 measured runs, temp 0.6 / top_p 0.95 / top_k 20). Prefill: 1342 tok/s @ 10k, 628 tok/s @ 90k Spec-decode: 7 draft… 6 arXiv — Machine Learning research 11d ago SW-ProxyCE: Zero-Query Adversarial Transfer from Public EEG Encoders to Private Downstream Models arXiv:2608.16931v1 Announce Type: new Abstract: Electroencephalography (EEG) foundation models have recently emerged as a promising paradigm for EEG decoding by learning reusable representations from large-scale heterogeneous neural recordings. However, the open release of EEG… 29 arXiv — Machine Learning research 11d ago Why GPT-Style Models Do Not Directly Transfer to Symbolic Music: Compression in the Wrong Coordinate System arXiv:2608.18025v1 Announce Type: new Abstract: GPT-style models achieve strong performance by representing language with finite vocabularies of reusable discrete tokens. This success has motivated symbolic music tokenizations to treat recurring musical structures, such as… 30 r/LocalLLaMA community 11d ago New midsize Qwen 3.8 model coming next week (hopefully) according to community manager! Community manager mentioned this in the Qwen Ambassador Discord, put an X reaction on someone asking for 35B... and said We'll have a new midsize open weight model coming next week (hopfully), This midsize model won't provide early access due to the schedule Thinking it's going… 12 Hugging Face Daily Papers research 11d ago Security Assessment of DeepSeek Harness with A.I.G: Evaluating Resistance to Indirect Prompt Injection Abstract Researchers evaluate indirect prompt injection risks in DeepSeek Harness using controlled taint and dual judges, finding notable success rates across text and file channels and recommending controls between untrusted content and sensitive actions. Generated by… 16 Vercel — AI dev-tools 11d ago Introducing Vercel for Slack Vercel Agent now works in Slack. Mention it the way you'd pull a teammate into a thread, and it reads the discussion, answers with the context of the platform running your app, and turns the team's decisions into changes you approve. Vercel for Slack is available today in Public… 10 Vercel — AI dev-tools 11d ago Vercel for Slack now in public beta Vercel Agent is now available in Slack. Mention @Vercel in any channel or thread, and Agent joins the conversation with relevant context from your Vercel projects, including deployments, builds, logs, metrics, configuration, and connected repos. For example, use it to:… 11 Vercel — AI dev-tools 11d ago Fish Audio models now available on Vercel AI Gateway for free Fish Audio 's audio models are now available on AI Gateway. To celebrate the launch, every Fish Audio model is free on AI Gateway for the next 30 days, through September 18. Capability Regular Through September 18 Text-to-speech $15.00 per million characters Free Speech-to-text… 22 Vercel — AI dev-tools 11d ago Compliance documents are now available in Team settings A new Compliance section in Team settings lets you preview and download Vercel's compliance documents directly in the dashboard. These include attestations like SOC 2 Type 2, security policies, and other security documents that are available through the Trust Center. You can… 18 Vercel — AI dev-tools 11d ago Exa joins the Vercel AI Gateway and Agent Marketplace Exa is now available on the Vercel AI Gateway and Agent Marketplace as a native integration. Exa's neural search engine grounds models in current information. Exa search is now a built-in tool on AI Gateway , which runs the search for you without an Exa account of your own. You… 17 Vercel — AI dev-tools 11d ago Vercel Python Queues SDK is now available in beta The Python SDK for Vercel Queues is now available in beta, bringing first-class Python support for running background workloads on Vercel. You publish messages to topics, and independent consumer groups process them in parallel with automatic retries, sharding, and delivery… 36 r/LocalLLaMA community 11d ago What is the best Qwen3.8 27b Abliterated version out there? I'm trying to get a model to reverse engineer / decompile or otherwise reverse to source some of my old c,c++, pascal, and asm demo programs I made from decades ago and I'm constantly met with refusals. It is highly annoying. Does anybody know of a good abliterated/uncensored… 24 r/LocalLLaMA community 11d ago I tested DFlash2 for Qwen3.8 27B on a 5090 Here's the DFlash2 announcement , and I was pretty excited for this after trying out DSpark on llama.cpp a few days ago and being somewhat disappointed that it wasn't really working. Anyways, I spent a while setting it up (you need to rebuild llama.cpp with pr #27342). Here's my… 19 Page 8 of 10 · 500 articles ← Newer Older →
