News / #open-source Tag Open source 500 articles archived under #open-source · RSS Sign in to follow r/LocalLLaMA community 19d ago Jev vs. Kev: open-source Jev alternative tested side by side We hosted Kev 4B (Jared Palmer's Apache-2.0 fine-tune of Qwen3.5-4B) and ran it side by side with Jev on the same endpoint to see how it compares. We built a fresh set of 362 items published after both models shipped (new arXiv papers, Stack Exchange questions, GitHub issues),… 9 arXiv — NLP / Computation & Language research 19d ago ChunkRank: Model-Aware Text Chunking and Abstention-Aware Answer Selection for LLM Pipelines arXiv:2609.29828v1 Announce Type: new Abstract: We present ChunkRank, an open-source Python library that derives chunk boundaries from a target model's tokenizer and context window, and selects an answer among candidates produced independently per chunk. It ships a validated… 38 Hacker News — AI on Front Page community 20d ago Show HN: Whiteboard (YC W26) – An open-source IDE for thoughtful software design Hello! We’re Sid, Alex, Ketan, and Milan. We’re building Whiteboard ( https://whiteboard.dev.fast/ ), an open-source desktop app where humans and agents can architect software together in a common workspace. Here’s our repo: https://github.com/devdotfast/whiteboard . We were… 4 The Information — AI news-outlet 20d ago Open Source, Model Price Cuts Keep AI Costs Under Control Open-source models as well as cheaper model releases from Anthropic and OpenAI are helping business customers rein in costs while getting as much or more out of AI, said speakers at The Information’s AI Agenda Live conference in San Francisco Wednesday. “The existence of open… 34 arXiv — Machine Learning research 20d ago TNLearn: An Open Source Python Package for Task-based Neurons arXiv:2609.27564v1 Announce Type: new Abstract: The brain does not rely on a single type of neuron to perform all kinds of tasks; instead, it designs different neurons for different tasks. The concept of task-based neurons represents a paradigm shift compared to task-based… 36 Hacker News — AI on Front Page community 20d ago Ideas on modernizing the open-source desktop Article URL: https://lwn.net/SubscriberLink/1095425/2d9f411252325784/ Comments URL: https://news.ycombinator.com/item?id=49825642 Points: 301 # Comments: 349 30 r/LocalLLaMA community 21d ago RSI ACHIEVED at Reef(Rumours again lol) and it's open source   submitted by   /u/Muhlwa_Sholanke [link]   [comments] 29 r/LocalLLaMA community 21d ago Nathan Lambert's written Congressional testimony on the state of open models - Chinese open-weight downloads now 2x America's, >80% of OpenRouter open-model usage Worth a read if you track open weights. Nathan Lambert (interconnects) posted the written version of his Congressional testimony on where open models stand. The numbers that got me: Hugging Face downloads of Chinese open-weight models are about 3.2B vs 1.6B American since he… 12 r/LocalLLaMA community 21d ago The attack on open weights continues to grow. Illinois folks (like myself), write your governor, please. And if you live elsewhere, please pay attention to your local/state politics. https://wgntv.com/politics-3/pritzker-establishes-ai-cabinet-to-assess-risks-protect-illinoisans/ “Artificial Intelligence has enormous… 8 r/LocalLLaMA community 21d ago stuntd: a local Jev-compatible server on Laya that learns from your own traffic (no API key needed) What it is. stuntd is a local proxy for typed LLM decisions: choice, yes/no, score. Your app keeps calling its provider through it. stuntd records the decisions, trains a small head on top of Laya (the open-weights System One model; the encoder stays frozen), serves it in shadow… 7 r/LocalLLaMA community 22d ago New 6B image model coming, AntLing just open sourced the Ming-Image-0.1-Design family • Ming-Image-0.1-Design, 6B • Ming-Image-0.1-Design-Layer, 6B • Two open-source Agent Skills: the Ling UI Design Skill and the Image-to-Editable-PPT Skill Ming-Image-0.1-Design ranks #1 among open-weight models on Artificial Analysis’s UI/UX Design leaderboard.… 12 r/LocalLLaMA community 22d ago AntLing open sourced the Ming-Image-0.1-Design family AntLing open sourced the Ming-Image-0.1-Design family: • Ming-Image-0.1-Design, 6B • Ming-Image-0.1-Design-Layer, 6B • Two open-source Agent Skills: the Ling UI Design Skill and the Image-to-Editable-PPT Skill Ming-Image-0.1-Design ranks #1 among open-weight models on Artificial… 9 The Information — AI news-outlet 22d ago Z.ai Open-Sources ZCode After Data Uploading Scandal Z.ai said that it has open-sourced its coding tool, ZCode, after the Chinese AI firm faced intense backlash from developers who found out that their data was being uploaded to cloud servers without their consent. “In response to the ZCode product security issues reported by the… 19 Latent.Space news-outlet 22d ago [AINews] Xiaomi MiMo-V2.6-Pro 1T-A42B: the new top Open Weights model, trained for $3M crowning a new Chinese frontier lab 38 arXiv — NLP / Computation & Language research 22d ago Replicating the Geometry of Emotion Representations in a Base Open-Weights Model arXiv:2609.22208v1 Announce Type: new Abstract: Sofroniew et al. (2026) report that emotion concepts in Claude Sonnet 4.5 are represented as vectors whose geometry mirrors human affect psychology. We replicate the representational core of that study on the base pretrained model… 8 r/LocalLLaMA community 22d ago 50+ Hours and 100M+ Tokens Later, Open Source Autonomous Agent is GETTING CLOSER at Solving an Open Math problem This experiment is live, you can inspect all the internal reasoning, memories, attempts here: https://artificium-covering-experiment.gr.bio/ The problem that the agent is trying to solve is a covering design problem: https://en.wikipedia.org/wiki/Covering_design Known as… 19 arXiv — Machine Learning research 23d ago Talk to Me, Jarvis: An Open-Source Edge-Deployable Voice Assistant Framework for Autonomous Racecars arXiv:2609.21109v1 Announce Type: new Abstract: Recent advances in large language models have improved their effectiveness as back-end components for voice assistants, particularly in intent understanding and context-aware input classification. However, online-hosted models… 13 arXiv — NLP / Computation & Language research 23d ago COAL-SQL: Coverage-Guided Augmentation and Failure-Driven Learning for Text-to-SQL Post-Training arXiv:2609.20842v1 Announce Type: new Abstract: Text-to-SQL translates natural-language questions into executable SQL queries, but open-source large language models still require task-specific post-training for complex, real-world SQL generation. Effective post-training requires… 28 r/LocalLLaMA community 23d ago convaiinnovations/laya (multilingual, non-autoregressive System 1 decision model) Laya is an open-weight (Apache 2.0) "System 1" decision model from Convai Innovations, built by Nandakishor M as an open alternative to TypeSafe's closed Jev API. Instead of generating text, it takes a state (text, an email, a ticket, or JSON) plus typed questions (choice to… 15 r/LocalLLaMA community 23d ago ZCode is now open source ZCode is now open source , and the reported security issues have been addressed. Source code: https://github.com/zai-org/ZCode The repo includes its desktop app, web workspace, backend, Agent CLI, and runtime. Official announcement: In response to the ZCode product security… 24 r/LocalLLaMA community 23d ago Wow... thank goodness for open weights!!!   submitted by   /u/johnnyApplePRNG [link]   [comments] 38 r/MachineLearning community 24d ago Hemmingway-1, an Apache-2.0 27B creative-writing fine-tune (Qwen3.8-27B base, EQ-Bench 4 1330)[R] we're a small lab (switzerland + south africa) and just open-sourced our first model: a 27b fine-tune of qwen3.8-27b specialized for creative writing and short-form personal text (stories, dialogue, roleplay, texts, emails). apache-2.0, plain weights on huggingface, 54.7 gb… 34 r/LocalLLaMA community 24d ago laya.cpp: Optimized laya near-instant decision making After seeing u/Nandakishor_ml’s post introducing Laya , I wanted to see how fast it could run in a standalone C++ implementation. Credit to u/Nandakishor_ml for the architecture, training and open-source release. My contribution is the inference implementation: laya.cpp , built… 25 r/LocalLLaMA community 24d ago Qwen-Image-2.1 released! Meet Qwen-Image-2.1, the most balanced and cost-effective image generation model in the Qwen-Image series! Now open weights! 🎨 A unified model for both generation and editing, delivering top-tier quality in a lightweight package. Highlights: - Compact & exceptionally fast: A… 5 r/LocalLLaMA community 24d ago a local Jev-style decision head onto Qwen 2.5 1.5B Jev from TypeSafe AI got me thinking about non-autoregressive decision engines, so I built a small proof-of-concept called AES to test the concept locally on open weights. It uses Qwen/Qwen2.5-1.5B-Instruct as the base. Instead of generating tokens, it runs a single prefill… 8 r/MachineLearning community 24d ago ProgramAsWeights: compile English function descriptions into neural programs that run locally [R] Given the recent interest in tools like Jev, I wanted to share ProgramAsWeights (PAW), an open-source research project I'm working on at the University of Waterloo. You describe a text function in English, compile it into a reusable neural program, and run it locally, including… 13 r/LocalLLaMA community 25d ago “DeadGrid” now open source exclusively made with qwen 3.8 27b Q4KM Play it right in your browser, no download. Some of the GLB’s are messy, but overall I’ve enjoyed playing with it, and the last iteration made was the gun/weapon placement. Contributors are welcome, would like to see what can be made of this from local inference only.… 4 r/LocalLLaMA community 25d ago Von: Open-source 395M "System One" model Took me a while since I'm on a family trip and have limited hardware, but here it is! Von: Open-source "System One" drop-in replacement for TypeSafe's JEV. https://github.com/wfzyx/von https://huggingface.co/wfzyx/von-1.0 It runs entirely on a CPU with 1–2 GB of memory (I… 21 Hacker News — AI on Front Page community 25d ago Laya the open source version of Jev Article URL: https://laya.convaiinnovations.com/ Comments URL: https://news.ycombinator.com/item?id=49765348 Points: 330 # Comments: 64 15 r/LocalLLaMA community 25d ago Qwen3.8-27B at 144 tok/s on an M5 Max MacBook Pro Meet Inco Splash, open-source inference engine, built around the model and around Apple silicon. Up to 3× the decode speed of Ollama, 2× oMLX, and almost 4× when an agent fans out into sub-agents. Requirements: M3 or newer, macOS 26.4+, 36 GB Get started with a single command:… 32 r/LocalLLaMA community 25d ago Alibaba open-sources medical AI model that can detect cancer and nearly 150 conditions Hopefully things like this let people understand there is good things that can come out of AI.   submitted by   /u/giveen [link]   [comments] 14 r/LocalLLaMA community 25d ago I truly think every major AI lab is purposefully making fear-mongering headlines to get regulations that hurt open-source models   submitted by   /u/Fusseldieb [link]   [comments] 35 r/LocalLLaMA community 26d ago ProgramAsWeights: describe an AI function in English, compile it once, and run it locally on CPU With the recent interest in Jev, especially in open-source and locally executable alternatives, I wanted to share a related project we've been building at the University of Waterloo: ProgramAsWeights (PAW). The idea is simple: describe a function in English, compile it once,… 9 Ars Technica — AI news-outlet 26d ago US government website used Chinese model the FBI called "malicious" The Federal Register website briefly used an open source Chinese AI search tool. 12 r/LocalLLaMA community 26d ago MiniMax Code is now open source. Maybe M3.1 is the next thing to watch. MiniMax has released the source code for MiniMax Code’s terminal agent: https://github.com/MiniMax-AI/minimax-code https://preview.redd.it/st9izmm8zaqh1.png?width=3016&format=png&auto=webp&s=5853bc316ea0b1823e42fd5574a4e713b47e3441 For those unfamiliar with it, MiniMax Code is… 35 r/LocalLLaMA community 26d ago MiniMax Code goes open source MiniMax has open-sourced the terminal version of MiniMax Code: https://github.com/MiniMax-AI/minimax-code How can developers verify the content that encoding proxies read, send, and store? This is a topic that has been widely discussed recently. Open sourcing the agent doesn’t… 4 r/LocalLLaMA community 26d ago China’s mysterious AI company Naive AI is valued at over $1.4 billion and could release its first open-source llm model as early as this month. According to people familiar with the matter, Naive AI, an AI startup founded in February this year by Tsinghua University professor Dai Jifeng, has completed three funding rounds totaling $400 million, bringing its valuation to more than $1.4 billion and earning it unicorn… 5 r/LocalLLaMA community 26d ago Flyweight: open-source C++/CUDA engine for running MoE models bigger than your VRAM on one GPU + system RAM. First PyPI release, looking for contributors. Been building this for a few months, mostly for myself, and it just got a proper release so figured I'd post it. It's a native GGUF inference runtime with OpenAI/Anthropic-compatible APIs and a chat UI. The whole point is one consumer NVIDIA card + lots of RAM: MoE models that… 21 r/LocalLLaMA community 26d ago Made the horizontal open-source model for Jev with RLCD, and it surpasses all the Jev benchmarks. HF space, benchmark, model, repo Thanks for the exceptional support ( https://www.reddit.com/r/LocalLLaMA/comments/1wijo3e/i_literally_built_the_jev_architecture_one_year/ ) and for the dozens of requests to make a generic model, run benchmarks, and create an HF space so anyone can test it. So here you go,… 30 arXiv — NLP / Computation & Language research 26d ago BurnRiSc: Toward Non-Invasive Burnout Screening in Open Source from Public Repository Signals arXiv:2609.19422v1 Announce Type: cross Abstract: Burnout is a chronic occupational syndrome, and open source is close to a worst case for it: maintainers absorb unbounded demand with no manager to reallocate work and no organization to notice decline. The cost is not only… 7 r/LocalLLaMA community 27d ago Thank you :) Swift Qwen 3.8 27B now has 100k+ downloads, is #1 finetune and #9 model on HuggingFace Trending Hey everyone, Jovan from UkisAI here, a small lab building the tech to make tiny frontier LLMs possible (and doing it open-source!) The purpose of this post is simply to thank the community for all the amazing finetunes, quantizations and overall improvements over our original… 38 Vercel — AI dev-tools 27d ago Run Terminal-Bench and other Harbor evals on Vercel Sandbox You can now run Harbor evals on Vercel Sandbox. Harbor is the open-source harness behind Terminal-Bench , whose registry includes many other benchmarks such as SWE-bench, tau3-bench and OSWorld. Pass --env vercel to harbor run and each trial executes in its own isolated… 18 r/LocalLLaMA community 27d ago We built an open-source GPU profiler you point an AI agent at, instead of reading traces yourself We've been tuning vLLM/SGLang/llama.cpp setups for a long time and got tired of the profiling part: nsys trace, open the GUI, squint, change a flag, repeat. The profilers assume a human is looking at the timeline. These days the thing doing our tuning is usually an agent, and it… 26 r/LocalLLaMA community 27d ago I literally built the Jev architecture one year back and completely open-sourced it with model, dataset and paper Everyone now talks about the architecture that's not auto regressive and does lightning fast probability prediction with a json schema. I worked on this literally one year back in March 2025, published an arxiv paper, pushed the model to huggingface along with the pypi package… 36 arXiv — NLP / Computation & Language research 27d ago From Pixels to Pairs: A Comprehensive Benchmark of LLM-Based Key-Value Extraction in Noisy Document Settings arXiv:2609.17538v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly used for structured information extraction from documents, yet their behavior under realistic OCR noise remains poorly understood. We present a systematic benchmark of open-source… 7 arXiv — NLP / Computation & Language research 27d ago NeMo Data Designer: An Extensible Framework for Multimodal Synthetic Data Generation arXiv:2609.17699v1 Announce Type: cross Abstract: We present NeMo Data Designer (NDD), an open-source, general-purpose framework for multi-modal synthetic data generation (SDG). Designed to be intuitive to use, NDD provides a declarative configuration format in which human… 37 r/LocalLLaMA community 27d ago I literally built the Jev architecture one year back and completely open-sourced it with model, dataset and paper Everyone now talks about the architecture that's not auto regressive and does lightning fast probability prediction with a json schema. I worked on this literally one year back in March 2025, published an arxiv paper, pushed the model to huggingface along with the pypi package… 38 Hacker News — AI on Front Page community 28d ago PS5 Linux lead quits: "a bunch of noobs using LLMs" that "they don't understand" Article URL: https://frvr.com/blog/news/ps5-linux-lead-quits-as-open-source-projects-have-become-a-bunch-of-noobs-using-llms-that-they-dont-even-understand/ Comments URL: https://news.ycombinator.com/item?id=49727627 Points: 216 # Comments: 130 37 arXiv — Machine Learning research 28d ago OPEN-1B: A Fully Auditable Training Run arXiv:2609.17380v1 Announce Type: new Abstract: Open-source language models have a reproducibility problem. Despite releasing weights, training data, and recipes, none of them are provably reproducible due to the non-associativity of floating-point arithmetic. Deep learning… 19 r/LocalLLaMA community 28d ago Open Source Appreciation Post It's late at night in the lab, I've been working on a basic script for a virology project, and holy hell the safeguards have been pissing me off. Mirroring detectEVE data over rsync to my laptop by making a zip file first? No no no, great safety mogul DARIO demands there be NO… 18 Page 3 of 10 · 500 articles ← Newer Older →
