News / #open-source Tag Open source 500 articles archived under #open-source · RSS Sign in to follow r/LocalLLaMA community 7h ago The AI race: China's open-weight models trail US closed models by just 7 months Source: whatmodel.sh , an open source AI leaderboard I built (and launched here yesterday). Every point comes from published benchmark results: 22,113 of them across 987 benchmarks, from 1,011 sources, each one linked to where it was published. This chart uses data for the text… 35 r/LocalLLaMA community 8h ago Anthropic Executive Says Open-Source AI Models Are Higher Risk https://www.bloomberg.com/news/articles/2026-10-14/anthropic-executive-says-open-source-ai-models-are-higher-risk https://www.business-standard.com/technology/artificial-intelligence/open-source-ai-models-carry-more-cybersecurity-risks-anthropic-executive-126101400731_1.html… 25 Hacker News — AI on Front Page community 10h ago Iosevka is an open-source, sans-serif and slab-serif, monospace font Article URL: https://typeof.net/Iosevka/ Comments URL: https://news.ycombinator.com/item?id=50084240 Points: 251 # Comments: 90 33 r/LocalLLaMA community 13h ago Updated list of official MCP servers (300+), well-known and widely used projects only We maintain an updated list of official MCP servers repo: 280+ well-known and widely used projects, all from the companies behind the products or actively maintained open source. Feedback and PRs welcome. github.com/VoltAgent/official-mcp-servers   submitted by  … 19 The Information — AI news-outlet 21h ago OpenAI Eyes Startup Acquisition That Could Boost Cybersecurity Business OpenAI, which is trying to develop a substantial cybersecurity business, is in early talks to buy Trail of Bits, a startup that finds and fixes vulnerabilities in open-source software, according to people familiar with the matter. The size of the potential deal couldn’t be… 25 r/LocalLLaMA community 1d ago Tencent open-sourced Agent Memory and it runs 100% locally on SQLite   submitted by   /u/AdamDhahabi [link]   [comments] 35 NVIDIA Developer Blog official-blog 1d ago NVIDIA Run:ai Is Now Open Source as Part of NVIDIA DSX AI Factory Platform Today, NVIDIA is making the full NVIDIA Run:ai platform available as open source software, giving customers, developers, and ecosystem partners access to... 32 The Information — AI news-outlet 1d ago Neocloud Prime Intellect Acquires Startup To Speed Up Inference Neoclouds and so-called inference providers that help app developers run open source models are trying to differentiate themselves in a very crowded market. For instance, one such neocloud, Prime Intellect , which was valued at $1 billion in an equity financing in July, is… 22 r/LocalLLaMA community 1d ago Built an open-source Cotypist/Granola hybrid: autocomplete on Gemma 4 E2B (~50 ms/suggestion on M4 Max) using your own meeting notes as context I built a desktop app harness that keeps local meeting notes and can use them to autocomplete my typing as well as complement my dictation with additional context via reading my screen or using the previous meetings notes. It's been a bit of a struggle to get it to work well and… 18 r/LocalLLaMA community 1d ago How far are we from a local model being able to optimize it's own runtime stack? A lot of projects have come up recently consisting of specific hardware config specialized forks of existing conferencing engines, but they all seem to be made using Claude or OpenAI's biggest frontier models. So given that open source is about 4-6 months behind, can we… 32 Simon Willison community 2d ago Hello Python 3.15, goodbye 3.10, and now I can use 3.11 Python 3.15 is here ! Here's the essential What's new in Python 3.15 guide, this year curated by 3.14 and 3.15 release manager Hugo van Kemenade. As someone who builds open source software that works in every supported Python version, I get to say goodbye to Python 3.10 and… 5 r/LocalLLaMA community 2d ago graphsignal-top: a `top` for inference GPUs in the open-source Graphsignal profiler, kernels ranked by time, live, with readable names A few weeks ago we posted the open-source Graphsignal profiler here: wrap vllm serve / sglang serve / whatever in graphsignal-run and it serves everything it measures as JSON, mainly so an agent can read it in a loop. Turns out we kept opening the JSON ourselves to see what the… 20 r/LocalLLaMA community 2d ago I made an open-source AI leaderboard that shows the best models your machine can run Hey everyone, I made whatmodel.sh To use it, Enter your RAM and GPU See what models you can run locally with its rank and the command to run it Compare them with API models on the same score Building it made me realise a 32GB Mac can now run a model that scores on-par with… 11 r/LocalLLaMA community 3d ago I built a lightweight tool that automatically frees up VRAM for gaming and restores your local LLMs afterward I run local LLMs pretty much around the clock, but I also enjoy gaming on the same PC. Having models sitting in VRAM while gaming isn't exactly ideal, and constantly unloading and reloading them manually got annoying. So I built GamePause . It's a lightweight, open-source… 33 r/LocalLLaMA community 3d ago OpenMed 3.0 is out: Apache-2.0 clinical AI that runs fully local and never falls back to the cloud. 422 open issues if you want in on 3.1 Hey r/LocalLLaMA ! Maintainer here. Some of you might remember OpenMed from our 1.8 post a few months back. Quick recap: it's an open-source (Apache-2.0) medical AI toolkit with one rule we never break: patient data stays on your machine. No API keys, no cloud calls, works… 31 r/MachineLearning community 3d ago [P] Pecision models that score every allowed label from the logits: Jebadiah v2.1 (27B, 9B), open weights and self-run benchmark results [P] I've been building open models that treat a decision as a closed-set scoring problem rather than text generation. The input is structured context plus a typed question with a fixed set of options. The output is a probability for each option, taken from the candidate-label… 23 r/LocalLLaMA community 4d ago Open-source Mac app that runs EmbeddingGemma 2 locally to search your files by what’s in them DigUp is a free Mac app that runs Google DeepMind’s new EmbeddingGemma 2 locally over your own files. The model puts text, images, audio and video in one space, so you describe what you remember and land on it: “zebra in a video” opens the clip at the moment it shows up “where… 10 r/LocalLLaMA community 4d ago Created laya : Now Introducing a new 800 Million Param physics-based typed decision model with 73k context and image support Around 3 weeks ago, I posted on this subreddit about how Jev used my one-year-old architecture, og post: https://www.reddit.com/r/LocalLLaMA/s/VpuMJt577S Then, just after that, I introduced Laya, the first open-source version of JEV, and it has reached a very large scale, thanks… 16 r/LocalLLaMA community 4d ago My "Anthropic/ChatGPT in a box" is... now open source and publicly hosted on Github. It's been a long time coming, and I should have done this in the first place. But LumaBrowser is now open source. Since I first released it a year ago, it's had several thousand installs and an absolutely tremendous amount of feedback. And it's come a long way. I don't call this… 17 Simon Willison community 4d ago Deno is joining Cloudflare Deno is joining Cloudflare The Deno team released the first version of celld back in August - their open source implementation of the Durable Objects pattern from Cloudflare Workers. Today, Cloudflare are acquiring Deno outright, with the goal of building on celld to "make… 7 r/MachineLearning community 5d ago Integrum - Reflection based MCP server from any Python Module/Library [P] Hi! I wrote a small library called Integrum that allows you to quickly create MCP server(s) from existing Python libraries or modules. It has a CLI so it is really easy to use (I hope!). It is open-source (MIT) and on PyPI, so sharing it here if somebody finds it useful. Code:… 13 r/LocalLLaMA community 5d ago GLM 5.3 Flash opensource @ the top of Artificial Analysis Cyber Index over Claude. It seems Dario's "too powerful for you users" strategy is paying off: we have two open models at the top of the leaderboard, surpassing every single model from Anthropic. Open source prevails. Even Mistral Large 4 is better!   submitted by   /u/LegacyRemaster [link]… 8 r/LocalLLaMA community 5d ago GitHub - google-ai-edge/ml-drift: GPU-Accelerated AI/ML Inference Blog Post : ML Drift: Next-Gen GPU AI/ML Inference at the Edge - Google Developers Blog The Google AI Edge Team is excited to announce the open-source release of ML Drift , our high-performance, cross-platform, on-device GPU compute engine specifically built for on-device AI/ML… 29 r/LocalLLaMA community 5d ago Qwen-Image-2.1-Turbo released! Qwen-Image-2.1-Turbo, create and edit images in just 8 denoising steps! Open weights now available! Built on Qwen-Image-2.1, Turbo is an accelerated checkpoint on the same 7B visual generation architecture. Fewer steps does not mean lower quality: it still generates strong 2K… 38 The Information — AI news-outlet 5d ago South Korean Banks Were Hacked Using Chinese AI Agent, Researchers Say The perpetrator of a recent hack of South Korean financial institutions that resulted in data leaks used an open-source Chinese AI agent called Artex and Chinese large language models, according to a report published this week by cybersecurity firm CrowdStrike. The analysis of… 7 The Information — AI news-outlet 5d ago Anthropic Announces Broader Cyber Defense Program Anthropic said Thursday it is launching new programs to support cybersecurity for critical infrastructure and open-source software. In a blog post, Anthropic said it would offer threat research, on-site engineers, and access to its frontier Claude models to infrastructure… 29 ThursdAI news-outlet 5d ago ThursdAI - Oct 8 - OpenAI drops 722 math papers, Haiku 5.5 hits 10 cents & more From CoreWeave: GPT-6 is free for everyone, open weights hit 1T params, an agent leaked its owner’s bank balance to Slack, Peter broke Arena’s 200M raise live, and Maxime Labonne on decision models. 7 Simon Willison community 5d ago ttok 0.4 Release: ttok 0.4 ttok is my CLI tool for counting tokens, using OpenAI's open source tiktoken library. It hasn't been in updated in a couple of years, but I finally fixed a Click warning, updated CI, and added a --list-models command to list available models. It works with uvx… 7 TechCrunch — AI news-outlet 6d ago Ben Affleck is an AI nerd, and the internet is impressed Ben Affleck is going viral for his deep knowledge of AI, from neural networks and transformers to open weights. The actor, who sold his AI filmmaking startup to Netflix earlier this year, is proving he's more than just a Hollywood star. 23 r/LocalLLaMA community 6d ago Open sourcing Game Summoner, my prompt to game site tldr: Open sourced my prompt to game suite: https://github.com/ndamiano/ai-agent-test , it's MIT licensed, and this runs well on my 5090 with 64gb ram, but any model that can handle tool calls can manage. Edit: I can't believe I forgot to share a game... This is one shot with… 13 r/LocalLLaMA community 6d ago Thank you :) Swift Models hit 2.2 million+ downloads / Early Access to New Models, Free Compute for Researchers Hey everyone, Jovan from UkisAI (Swift Qwen) here! For those who don't know us, UkisAI is a small lab making tiny frontier LLMs, tools and datasets (+doing it open-source!). I'm one of the guys running it aka I train the models and post on Reddit. Our first open-source release… 29 r/LocalLLaMA community 6d ago I built an open source framework for building RL environments. Named "Seahaven" after the fake town in The Truman Show. I've been optimizing long-running agents: rewriting their prompts, tools, skills and subagents, and keeping the changes that score better. I've been working on some version of this problem for over a decade (at Apple, my own startup, now Kiln). The hard part is the eval… 31 r/LocalLLaMA community 6d ago We unlearned CCP alignment from Qwen3.6-35B-A3B: censored/propaganda answers 89.8% → 2.8%, general benchmarks within ~1 point (open weights) Disclosure: I'm a researcher at Hirundo, the company that made this. Happy to answer anything. Qwen ships with the CCP's political alignment trained in. Ask Qwen3.6 what happened on June 4, 1989 and it says "I don't know what you are referring to." A system prompt doesn't… 10 r/LocalLLaMA community 6d ago Last week some of South Korea's biggest banks were hit by a cyberattack. We now know the entire hack may have been done by a single person. He used a combined stack of an open-source AI penetration tool named ARTEX, DeepSeek v4.1-Flash, GLM-5.3, Grok 4.6, and Claude Code… CrowdStrike report: https://www.crowdstrike.com/en-us/blog/unknown-threat-actor-uses-artex-to-target-south-korean-finance/ From: Andrew Curran on 𝕏: https://x.com/AndrewCurran_/status/2108108695876092323 Jukan ✈️OCP 2026 on 𝕏: https://x.com/jukan05/status/2108110513033093369… 14 arXiv — NLP / Computation & Language research 6d ago Tokka-Bench: Evaluating Tokenizers Across 100 Natural and 20 Programming Languages arXiv:2610.08794v1 Announce Type: new Abstract: Large language models rely on subword tokenizers whose quality varies across languages, yet no standardized multi-metric framework exists for broad comparative evaluation. We introduce Tokka-Bench, an open-source framework that… 19 arXiv — NLP / Computation & Language research 6d ago How Do LLMs Change Predictions Under Negation? arXiv:2610.09571v1 Announce Type: new Abstract: Negation is an essential feature of human language, yet large language models (LLMs) remain unreliable in processing it. We evaluate recent open-source and closed-source LLMs on our negation benchmark and find that, in 37-71% of… 34 r/LocalLLaMA community 6d ago Same prompts to 371 models since May 2024, all the answers in one place Made this (free, no signup). One shot per model, no system prompt, temp 0.7. Lots of open weights in there, plus 93 models you can't run anymore. museumofmodels.com   submitted by   /u/sirjoaco [link]   [comments] 15 Ars Technica — AI news-outlet 6d ago “Software is over”: Bold AI developer takes aim at Adobe with open source clones Opus-built Creative Cloud alternatives are ambitious, free, and nowhere near finished. 7 The Information — AI news-outlet 7d ago Where Nvidia’s $100 Billion Dealmaking Juggernaut Will Go Next This July, Nvidia caught wind of a looming takeover of OpenRouter, a three-year-old startup that had emerged as a popular marketplace for AI models, including many cheaper open-source ones. Databricks and Stripe had already been talking to the startup about a potential sale.… 35 Hacker News — AI on Front Page community 7d ago Strands Decider 2B: a small, open-source, decision model Article URL: https://strandsagents.com/blog/introducing-strands-decider/ Comments URL: https://news.ycombinator.com/item?id=49987076 Points: 204 # Comments: 50 19 r/LocalLLaMA community 7d ago Europe rejoins the fight with Chonky! Mistral Large 4 Released, Open weights end of month, who’s ready? 1 trillion parameters, 49B active, definitely chonky! If you don’t love the model you gotta at least love the humor in the name - Le Chonk   submitted by   /u/chemist_slime [link]   [comments] 13 Hacker News — AI on Front Page community 7d ago Penguin Mail – open-source Rust email client for Linux with AI Article URL: https://penguin-mail.com/ Comments URL: https://news.ycombinator.com/item?id=49984716 Points: 201 # Comments: 128 6 Simon Willison community 7d ago EmbeddingGemma 2 My comment on EmbeddingGemma 2 — Hacker News. I really appreciate that EmbeddingGemma 2 is under the Apache 2.0 license. For embedding models in particular, I don't think it makes sense to use a closed, proprietary, hosted-only model. Most applications of embedding models… 37 TechCrunch — AI news-outlet 7d ago How AI decision models could change content moderation On Tuesday, Musubi announced a lightweight decision model made for real-time moderation called PolicyLM-1.7B, released with open weights. 13 Simon Willison community 8d ago Using Parseable with Datasette for OpenTelemetry traces TIL: Using Parseable with Datasette for OpenTelemetry traces I saw Parseable in a Show HN today - it's a new observability platform with both an open source (AGPL) Rust implementation (a single ~180MB binary), an "Enterprise" version with extra features and a cloud hosted… 14 r/LocalLLaMA community 8d ago Aplomb 1: open-weights 5.3B decision model, 1M context, text/image/video/audio in one request, #1 among 4B models on the Decision Index We released Aplomb 1 today, a 5.3B decision model with open weights. It reads up to 1M tokens of text, JSON, images, video and audio in a single request, and on our API it makes a decision on a 1M-token document in about 3 seconds, at $0.02 per 1M input tokens with free output… 36 Hacker News — AI on Front Page community 8d ago OpenTPU – An open-source AI accelerator, developed by AI Article URL: https://github.com/FeSens/openTPU Comments URL: https://news.ycombinator.com/item?id=49980715 Points: 209 # Comments: 273 4 TechCrunch — AI news-outlet 8d ago LibreOffice says ‘no AI’ is now a software feature The maker of the open source document editor says it has no plans to add AI to its software's default configuration, citing user privacy. 4 Interconnects (Nathan Lambert) research 8d ago The Cyber Risk Discourse is Broken Open-weights, ideology, and acknowledging trade-offs. 26 r/LocalLLaMA community 8d ago Mistral releasing new open weights model "Le Chonk" LeChonk-1T-A49B Weights to be released by the end of the month. This probably means the fat kitten is dead. Also: gotta love the release movie.   submitted by   /u/wapswaps [link]   [comments] 32 Page 1 of 10 · 500 articles Older →
