News / #open-source Tag Open source 500 articles archived under #open-source · RSS Sign in to follow r/LocalLLaMA community 8d ago Tencent releases Octop, a self-hosted AI assistant Octop is an open-source, self-hosted AI assistant. Through its multi-agent architecture, it builds an intelligent environment that is both independent and collaborative for teams, families, and individuals. Best of all, it runs entirely on your machine, the fully self-hosted… 5 Latent.Space news-outlet 8d ago [AINews] Reflection Beam - 501B-A23B American Open Model A small win for US open source 23 r/LocalLLaMA community 8d ago When will we get another good American open weights model? Every time I check the top models on HF, I basically feel like this:   submitted by   /u/cyber_burr [link]   [comments] 8 The Information — AI news-outlet 8d ago Reflection AI Announces First Open Source Model, Beam Reflection AI, a 2-year old Nvidia-backed startup, announced its first open-weight model, adding to a collection of U.S. competitors aiming to catch up to the performance of similarly free models from China. In its announcement Monday, Reflection said it is still evaluating and… 10 r/LocalLLaMA community 9d ago Speakrail - a low-latency fully-local voice assistant that runs on a single RTX 4090 tl;dr: I created a fully-local open-source full-duplex voice agent that rivals GPT-Live on some benchmarks. It uses Voxtral Realtime with a turn-taking head, a microturn-finetuned Gemma 4 12B and Breeze TTS 2 under the hood. Go try it out: https://github.com/speakrail/speakrail… 21 r/LocalLLaMA community 9d ago I built an open-source real-time Japanese anime subtitle & translation engine powered by Whisper-Large-v3 + Groq / DeepSeek Hey r/LocalLLaMA , Like many anime fans, I've always been frustrated by traditional MT engines (like Google Translate or base DeepL) when dealing with raw Japanese anime: - They completely butcher Japanese honorifics, sentence-ending particles ( -tteba , -zo , -desu wa ), and… 25 r/LocalLLaMA community 9d ago Infermeld: a Linux kit for running one GGUF across AMD + NVIDIA GPUs with llama.cpp Following on from club-5060ti and club-rdna16 , I’ve put together Infermeld : a small, open-source Linux companion kit for running one GGUF across an AMD GPU and an NVIDIA GPU, powered by llama.cpp. I’m the maintainer. This is an experimental v0.1.0 release , and I’m looking for… 24 TechCrunch — AI news-outlet 9d ago Google froze its open source bug bounty program due to a ‘significant rise’ in AI submissions AI slop seems to be overwhelming bug bounty programs. 32 r/MachineLearning community 10d ago Nonobench: an open benchmark of 49 LLMs on nonogram puzzles, public and open source [P] Nonobench measures how well LLMs solve nonograms (picross). Each model gets the row and column clues once and returns the full grid. No tools, one attempt per puzzle. Method: - Standard mode: 30 puzzles from 5x5 to 15x15 (from the Nonograms dataset by Moyà-Alcover, CC BY 4.0). -… 22 r/LocalLLaMA community 10d ago Least sycophantic modern open LLM? So Kimi K2 is outdated, and so is GPT OSS 120b. Which of the modern open weights models can boast the least sycophancy? I need this both for creative/research assistant usage (sycophancy led me down blind alleys of my own bad ideas many times) and agentic coding (more sycophancy… 21 r/LocalLLaMA community 11d ago I built a code knowledge graph tool that's actually MIT licensed (fully local, no cloud) So this is maybe a niche problem, but at my job I work on a huge Python codebase and every time I change some shared function I'm basically playing roulette. grep tells who mentions it in the code base, not who actually calls it. And more essentially, Claude Code (my major… 15 r/LocalLLaMA community 11d ago Aleph-Alpha/Kolibri-1 · Hugging Face - 78B parameters. 3.46B active. Up to 1M tokens of context - Apache 2.0 From Aleph Alpha on 𝕏: https://x.com/Aleph__Alpha/status/2106306840657297814 Tech report: https://aleph-alpha.com/downloads/tech-report.pdf   submitted by   /u/Nunki08 [link]   [comments] 15 r/LocalLLaMA community 11d ago The ultimate guide to multi-harness RL Hi folks, it's Lewis here from the post-training team at Hugging Face. We've been exploring how to train open models in different coding harnesses and wrote up a looong guide on how we solved this using open source libraries like TRL and the Harbor framework for RL environments.… 23 r/LocalLLaMA community 11d ago Could the EU Kids Act (or the like) be use potentially(Trojan horse) as excuse to go after the AI Open weights?   submitted by   /u/UltraFOV [link]   [comments] 31 r/LocalLLaMA community 11d ago DataInventor: an open-source replication of Adoption Lab's Invent a Dataset   submitted by   /u/asankhs [link]   [comments] 29 r/LocalLLaMA community 12d ago Apex Compute developing open-source Mesa Vulkan driver for their hardware   submitted by   /u/Fcking_Chuck [link]   [comments] 11 r/LocalLLaMA community 12d ago Perplexity Decider 27B: Open weights decision model fine tune of Qwen3.8 27B   submitted by   /u/rm-rf-rm [link]   [comments] 37 r/LocalLLaMA community 12d ago Gufo performance .... 70tps Qwen 3.8 27b but you need to read the fine print. So everyone has been yelling about how I should be using Gufo instead of halogen because it's open source and it's "just as good or better". Checking in on their GitHub (GitHub.com/gufo-org/gufo) got me immediately .. "Qwen 27B Q4: 70.56 tok/s single user, 123 tok/s with 8… 19 r/LocalLLaMA community 13d ago Clef: Open Weights decision model by Cloudflare   submitted by   /u/paf1138 [link]   [comments] 25 Hacker News — AI on Front Page community 13d ago Clef: Open-source decision models, and new RL fine-tuning platform Article URL: https://blog.cloudflare.com/clef-decision-models/ Comments URL: https://news.ycombinator.com/item?id=49923692 Points: 246 # Comments: 92 18 arXiv — NLP / Computation & Language research 13d ago Drift Inspector: Exploring and Measuring Scientific Drift with Atomic Contribution Claims arXiv:2609.39710v1 Announce Type: new Abstract: Scientific abstracts mix contributions with background, motivation, and meta-language, so tools that read them as-is cannot separate what a field produces from what it discusses. We present Drift Inspector, an open-source system… 8 r/LocalLLaMA community 13d ago Astrabox - Open source Arcade Game Generator Hey everyone! I’ve been working on ASTRABOX : an arcade interface where you describe a game, the AI builds it, and you can ask for changes by voice while playing. Each game gets its own visuals and gameplay, while a shared runtime handles controllers, scores, player joining,… 8 r/LocalLLaMA community 13d ago Two open-weights releases: Victoria (Qwen3.8-Flash-Next with 44% of experts cut, 70% Terminal-Bench 2.1, GGUF included) and Maple (a Canada-first fine-tune) We had a Dell B300 in the lab for a few weeks and used it to create two fine tunes of Qwen Flash Next. Victoria (coding and agents) Qwen3.8-Flash-Next cut down by 44% using a paper / technique called REAP: 512 down to 288 per layer. Retrained at 4-bit (NVFP4) afterwards, so it's… 21 r/LocalLLaMA community 13d ago Open source inference engine (like LM Studio or Unsloth Desktop) that optimizes itself for your exact hardware. Compiles and tunes its kernels on your device, so open models run up to 2x faster than llama.cpp. Works on Apple Silicon, NVIDIA, AMD or nothing but a CPU.   submitted by   /u/paranoidray [link]   [comments] 34 The Information — AI news-outlet 13d ago DeepSeek Open-Sources Software Tools for Huawei AI Chips DeepSeek said Wednesday that it would open-source software tools that are customized for Huawei’s AI chips, as the Chinese AI firm steps up its efforts to use domestic semiconductors for training and running its models. The software tools include a Huawei-compatible version of… 33 r/LocalLLaMA community 14d ago Another Ling model comes out, same receipt, 2 weeks free to use, then open source. Chinese labs do contribute a lot to open source community Ling-3.1-flash: ~560B total params, ~25B active/token, up to 1M-token context. Across work, coding & healthcare: 1,673 Elo on GDPVal-AA v2.1, 75.16 on FrontierSWE, and 65.35 on HealthBench Professional.   submitted by   /u/Elouakili_Flexy [link]   [comments] 16 r/LocalLLaMA community 14d ago Ling-3.1-flash: ~560B total params, ~25B active/token, up to 1M-token context- Free trail for 2 weeks then open source   submitted by   /u/Muhlwa_Sholanke [link]   [comments] 11 r/LocalLLaMA community 14d ago We just open-sourced the world's fastest WebGPU kernels for local AI on Hugging Face The collection includes kernels for more than 200 common ML operations, all of which can run entirely locally in your browser on WebGPU. We're also working to upstream these optimizations to Transformers.js, ONNX Runtime Web, LiteRT.js, and more! Kernels:… 14 MIT News — AI research 14d ago MIT Transit Lab to develop an AI platform for public transit agencies With $2.1 million funding from Google.org, the open-source Public Transit Intelligence Hub will unify public transit monitoring, operations, and passenger communication. 11 r/LocalLLaMA community 14d ago Oído: speech recognition that beats Whisper-tiny, running on a $5 microcontroller (open source) I'm part of the Lokutor team that built this. Model: NVIDIA Conformer-CTC Small (13M params, int8). It runs on an ESP32-S3 with 8 MB PSRAM, no GPU or NPU. LibriSpeech WER is 3.7 / 8.2, versus 6.3 / 15.9 for Whisper tiny.en on a laptop. Under real noise (DEMAND: car, kitchen,… 16 arXiv — NLP / Computation & Language research 14d ago MultiTalk: Scaling Full-Duplex Speech Models to Long, Multi-Party, Bilingual Conversation arXiv:2609.36903v1 Announce Type: new Abstract: End-to-end full-duplex speech models have brought open-source machine conversation closer to human-like interaction, yet existing systems remain limited in two intertwined dimensions: long-context robustness and multi-party… 38 arXiv — NLP / Computation & Language research 14d ago What Does Post-Training Change in Multilingual Reasoning? arXiv:2609.37104v1 Announce Type: new Abstract: Open-source reasoning models provide unequal access to reasoning capability across languages. When a model can solve a problem but cannot deliver a complete solution in the user's language, language becomes an access barrier rather… 30 NVIDIA Developer Blog official-blog 15d ago AI Native by Design: Lessons Learned from Building NVIDIA TensorRT Model Connect Parallel work, model-family isolation, reversible changes, and GPU-backed validation shaped an open source project designed around coding agents NVIDIA TensorRT... 16 r/LocalLLaMA community 15d ago Thanks to you r/LocalLLaMA, my mom was able to use my app! The open-source app that can watch your screen and trigger actions. It is now easy to use, thanks to your feedback. TL;DR: I'm a solo dev who wanted a simple, private way to have local LLMs watch my screen and do simple logging/notifying. After a year of building, I released v3.0.0 and my mom was able to use it for the first time and I wanted to say thank you! Hey r/LocalLLaMA , What is it… 9 r/MachineLearning community 15d ago I wrote a free, open-source book on making ML models actually fast, from silicon to agents [P] I’ve spent the last few months writing something I wish I had when I started working on ML performance engineering. It’s called How to Make Your Model Fast: A Systems View of Efficient Machine Learning, from Silicon to Agents . The basic idea is that reducing FLOPs doesn’t… 35 arXiv — Machine Learning research 15d ago PixSim: a calibrated open-source simulator of instant-payment fraud, recovery and interdiction under analyst capacity constraints arXiv:2609.30684v1 Announce Type: new Abstract: Brazil's Pix settles about 5.9 billion instant, irreversible transfers a month. A fraudulent transfer can be recovered only while the funds remain in a traceable account, and in 2025 the Central Bank's recovery mechanism (MED)… 17 r/LocalLLaMA community 15d ago nvidia/NVIDIA-Nemotron-Labs-3-Competitive-Coding-550B-A55B-NVFP4 · Hugging Face Model Developer: NVIDIA Corporation Model Development: Fine-tuned from NVIDIA-Nemotron-3-Ultra-550B-A55B What is Nemotron? NVIDIA Nemotron™ is a family of open models with open weights, training data, and recipes, delivering leading efficiency and accuracy for building… 21 r/LocalLLaMA community 16d ago Trained locally: ultra-fast 0.8B/2B System 1 decision models that match Jev on benchmarks and Doom, ~30 ms per decision (open weights) TL;DR: The Jeff models are a set of Qwen3.5 and Gemma fine-tunes for zero-shot classification: small, efficient, open-weight models with respectable out-of-the-box performance that can be slotted right into code or fine-tuned/LoRA-trained as needed. Give them a situation and a… 12 r/MachineLearning community 16d ago Browser demo of our Clash Royale RL environment: a 5.6k-parameter REINFORCE policy learns defensive placement against a brute-force optimum [P] Yesterday I shared our open-source Clash Royale simulator and its recurrent PPO agent here. A training loop is easier to understand when you can watch it, so we put a small interactive version online: https://itzik123.github.io/ClashRoyaleAi/lab/ The task is one decision. An… 35 r/LocalLLaMA community 16d ago NVIDIA shipped OpenShell, an open source sandbox that gives local and open agents real runtime limits instead of prompt rules. Over 100 firms joined the safety stack. OpenAI did not. https://x.com/JensenHuang/status/2104499465055023424   submitted by   /u/InternationalGap3698 [link]   [comments] 14 r/MachineLearning community 16d ago Free, open-source AI engineering course where you build each algorithm by hand: 523 lessons, now as EPUB/PDF books [P] AI Engineering from Scratch is an MIT-licensed curriculum: 523 lessons across 20 phases, from linear algebra and backprop to transformers, LLMs, agents, and production serving. The code is stdlib-first, so you see every step instead of calling a library. This month's edition: -… 37 arXiv — NLP / Computation & Language research 16d ago THA: Weighted Finite-State Text Normalization and Inverse Text Normalization for Khmer arXiv:2609.30984v1 Announce Type: new Abstract: Text-to-speech needs written text in spoken form, and speech recognition output needs the reverse. For Khmer, neither direction has a maintained open-source tool, and the script makes both harder: words are not separated by spaces,… 8 r/MachineLearning community 16d ago OpenTrainDNN: A Browser-Based Real-Time Neural Network Visualizer.[P] OpenTrainDNN is an open-source, client-side web application designed to render the step-by-step training mechanics of deep neural networks in real-time. It provides direct visibility into backpropagation, activation flows, and weight updates without requiring backend servers,… 13 r/LocalLLaMA community 16d ago Qwen company already rushed out a Jev competitor. No open weights yet. It's called decision-model-preview. There is only a docs page. No announcement or anything. I can't post a link because reddit's filters just deletes posts that contain a link to the cloud platform that hosts it. But you'll find the page if you Google the model name.  … 28 r/LocalLLaMA community 17d ago We released VeriLoop E2 (27B, Apache-2.0). The design question behind it: should an LLM be allowed to commit its own state? Disclosure: I’m one of the authors of VeriLoop E2, a 27B model post-trained from Qwen3.8-27B. The weights are Apache-2.0; the harness we evaluate it in is not open source (details at the bottom). This is a release post, but rather than a benchmark dump I want to talk about the… 28 r/LocalLLaMA community 17d ago What if open-source AI focused less on giant models and more on reusable capabilities? Instead of everyone building another general-purpose model, the community could distill open models into domain specialists—biology, Python, accounting, OCR, and more. Developers could combine these capabilities into local tools: small model + OCR + accounting → local accounting… 13 r/MachineLearning community 17d ago ClashRoyaleAi: an open-source, deterministic Clash Royale simulator for RL, with recurrent PPO, lookahead search and expert iteration [P] The opponent plans by simulation: every second it scores each candidate play by running the match 10 seconds ahead in the engine. Our PPO agent learned to park its Cannon behind its own King. Losing a building in a fight cost reward, and letting it decay cost nothing, so it… 8 r/LocalLLaMA community 17d ago SupersonicLabs/Julia-1 · Hugging Face New open source Jev like model for running on local devices from a group called Supersonic Labs. It's a 144M param local non-generative local classifier. From their site : Julia 1 opens our research into compact decision models. It builds on mmBERT-small , a multilingual… 15 r/LocalLLaMA community 17d ago I added Qwen-Image 2.1 + LoRA support to TensorSharp (GGUF, local inference) I maintain TensorSharp , an open-source inference engine. It can now run Qwen-Image 2.1 locally for text-to-image generation and image editing, with support for its LoRA adapters. I’ve added configs for regular style and editing LoRAs, plus accelerated adapters with their own… 14 Hacker News — AI on Front Page community 19d ago Ollaya – Ollama for open-source, Jev-style decision models Article URL: https://ollaya.dev/ Comments URL: https://news.ycombinator.com/item?id=49848269 Points: 255 # Comments: 81 30 Page 2 of 10 · 500 articles ← Newer Older →
