Version Bump AI News & Updates

vLLM releases dev-tools 26d ago

v0.30.0rc2

[Bugfix][NIXL] Avoid receive reports for notification-only requests (…

22

Ollama releases dev-tools 26d ago

v0.34.3-rc0

api: expose model thinking levels and defaults ( #18473 )

35

Hacker News — AI on Front Page community 26d ago

Claude Code now reads AGENTS.md if there is no Claude.md

Article URL: https://code.claude.com/docs/en/changelog Comments URL: https://news.ycombinator.com/item?id=49760187 Points: 271 # Comments: 109

10

OpenAI Python SDK releases dev-tools 26d ago

v3.16.1

3.16.1 (2026-09-18) Bug Fixes api: avoid loading unrelated API resources on first use ( #3898 ) ( 68e4317 )

25

Vercel — AI dev-tools 26d ago

v0 now reads npm credentials from shared environment variables

v0 now installs private packages from npm and custom registries using credentials stored as shared environment variables on Vercel. This makes it easier for teams to build with their existing design systems, component libraries, and internal packages directly in v0. To get…

27

Anthropic SDK (Python) releases dev-tools 26d ago

v1.7.0

1.7.0 (2026-09-18) Full Changelog: v1.6.0...v1.7.0 Features api: add group with display_name to rate limits, deprecate group_type ( 28f0a83 ) tools: add compact_before_next_turn() to the tool runner ( #641 ) ( 8b23fb3 ) Bug Fixes bedrock: raise an API error for eventstream…

24

OpenAI Python SDK releases dev-tools 26d ago

v3.16.0

3.16.0 (2026-09-18) Features api: add webhook endpoint management ( #3892 ) ( 9a11f6e ) Chores api: deprecate MCP connector_id ( #3894 ) ( 1ccaf07 )

26

arXiv — NLP / Computation & Language research 26d ago

DeepSeek-V4.1-Flash: Pushing the Limits of KV Cache Compression

arXiv:2609.19969v1 Announce Type: new Abstract: The widespread adoption of long-horizon agents has made model workloads increasingly input-heavy. Although prior work has substantially reduced the cost of long-context computation, prefill remains computationally expensive, and…

36

OpenAI Python SDK releases dev-tools 26d ago

v3.15.0

3.15.0 (2026-09-18) Features api: add agent session model settings ( #3882 ) ( 4b15817 ) api: add audio-mini model choices ( #3886 ) ( a6eeb3f ) api: add compaction progress events ( #3866 ) ( 98e1d24 ) api: add managed Responses WebSocket sessions ( #3887 ) ( 3b865af ) api: add…

31

Ollama releases dev-tools 27d ago

v0.34.2

x/transfer, server: tighten redirect handling for registry requests (…

19

Ollama releases dev-tools 27d ago

v0.34.2

What's Changed llama.cpp updates Full Changelog : v0.34.1...v0.34.2-rc0

19

Ollama releases dev-tools 27d ago

v0.34.2-rc2: mlxrunner: Release freed KV buffers during speculative decode

The decode loop releases MLX's pool of freed buffers every 256 generated tokens, which is also how often the KV cache grows and drops its previous, smaller buffers. The check fires only when the token count lands exactly on a multiple of 256. Speculative decoding emits several…

28

llama.cpp releases dev-tools 27d ago

b11020

chat : add message delimiters to the DeepSeek V3.2/V4 parser ( #29008 ) chat : add message delimiters to the DeepSeek V3.2/V4 parser Assisted-by: Claude Co-authored-by: Sigbjørn Skjæret sigbjorn.skjaeret@huggingface.co Website: https://llama.app Attestations:…

8

vLLM releases dev-tools 27d ago

v0.30.0rc1: [Bugfix] Isolate supplemental FlashInfer BF16 autotuning (#57285)

Signed-off-by: jiahanc 173873397+jiahanc@users.noreply.github.com Co-authored-by: OpenAI Codex codex@openai.com

16

arXiv — NLP / Computation & Language research 27d ago

SEA-LION-v4.8: A Technical Report

arXiv:2609.18310v1 Announce Type: new Abstract: We introduce Nemotron-SEA-LION-v4.8, a family of Southeast Asian Languages in One Network (SEA-LION) built upon NVIDIA Nemotron 3. The family includes 30B-A3B and 120B-A12B models, with both continued-pretrained base checkpoints…

14

vLLM releases dev-tools 27d ago

proto-v0.3.0

Release vllm-proto 0.3.0

25

Ollama releases dev-tools 28d ago

v0.34.2

What's Changed llama.cpp updates Full Changelog : v0.34.1...v0.34.2-rc0

4

vLLM releases dev-tools 28d ago

proto-v0.2.0: vllm-proto 0.2.0

Validated by PR #56538 CI at fa2a26f .

23

OpenAI Python SDK releases dev-tools 29d ago

v3.14.1

3.14.1 (2026-09-15) Bug Fixes client: validate retry limits and preserve application errors ( #3867 ) ( f86c721 ) correct typo "th" to "the" in StreamAlreadyConsumed error message ( #3022 ) ( 7186203 ) examples: correct Azure endpoint hostname ( #3298 ) ( 543516c ) examples:…

16

ComfyUI releases dev-tools 29d ago

v0.36.0

ComfyUI v0.36.0

29

Ollama releases dev-tools 29d ago

v0.34.2-rc0: llama.cpp: version bump b10969 (#18446)

llama.cpp build changes resulted in duplicate symbols between libllama and libmtmd. This moves the compat patch into libllama with exported symbols.

21

r/LocalLLaMA community 29d ago

Koboldcpp v1.121 released

  submitted by   /u/Fcking_Chuck [link]   [comments]

23

Anthropic SDK (Python) releases dev-tools 29d ago

v1.6.0

1.6.0 (2026-09-15) Full Changelog: v1.5.0...v1.6.0 Features api: add auto mode tool permissions for Managed Agents ( 909d92f ) api: add compaction parameter and signed compaction blocks (beta) ( 8689179 ) api: add enum types for workspace data-residency geo fields ( 3dc6dbf )…

37

r/LocalLLaMA community 29d ago

DeepSeek V4.1F Q4 on M3 Ultra with native DSpark MTP (40tps / 800tps)

I liked DeepSeek V4.1 Flash as an agent model but at 16 t/s on ds4 it was painful to sit through a real turn. It seemed some redditors and m3 ultra owners appreciated my glm 53 flash optimizations, so I forked antirez/ds4 for V4.1 Flash to see how much I learned optimizing GLM…

30

Ollama releases dev-tools 29d ago

v0.34.1

docs: refresh getting started guides ( #18450 )

16

Ollama releases dev-tools 29d ago

v0.34.1-rc2: API: Deprecate typical_p (#18448)

Drop support for creating new models with typical_p parameters, while retaining support for existing GGUF models with the setting.

7

OpenAI Python SDK releases dev-tools 1mo ago

v3.14.0

3.14.0 (2026-09-14) Features streaming: normalize errors raised while reading streams ( #3827 ) ( d7c41ef ) Bug Fixes bound vector store file polling ( #3401 ) ( ae41bc4 ) example: refresh realtime push_to_talk_app session types ( #2926 ) ( 0b7ad38 ) files: normalize PathLike…

35

r/LocalLLaMA community 1mo ago

DeepSeek engineer relections on RSI - burying my talent to yesterday

Note - This is translated from the actual blog link right at the bottom. A few days ago, DeepSeek v4.1 was released. It raised the ability of small models to a new level. AI is improving much faster than anyone expected. From the first ChatGPT that could only chat simply with a…

21

ComfyUI releases dev-tools 1mo ago

v0.35.2

ComfyUI v0.35.2

26

r/LocalLLaMA community 1mo ago

Animated transition from AA Intelligence Index v4.1 to v4.3

I had all the data saved from AA's v4.1 index, so when they upgraded it in the wake of Astra's release, I could actually generate a before/after comparison. All intelligence and price per task are sampled from AA on Sep 3rd and Sep 14th respectively. Price per task of some open…

26

Ollama releases dev-tools 1mo ago

v0.34.1-rc1

mlx: add mlx patch to docker build context ( #18440 )

14

llama.cpp releases dev-tools 1mo ago

v0.4.1

Overview llama.cpp 0.4.1 adds Maple 20B-A1B, Tencent Hy 4, and Spark2.5 support, improves JSON schema handling, chat parsing, logging, and server child-process management, and updates ggml to v0.24.0. API changes Changed llama_sampler_chain_n() to return int32_t instead of int (…

8

Ollama releases dev-tools 1mo ago

v0.34.1-rc0: MLX: version bump (#18235)

MLX: version bump mlx: support ModelOpt global scales in MoE models address comments address comments

19

r/LocalLLaMA community 1mo ago

3D viz of how Deepseek Flash v4.1 is different from a typical decode only transformer

https://whip.run/experience/356b3eba-23ce-4dc8-bff2-4f7bc1862966   submitted by   /u/tempNull [link]   [comments]

30

r/LocalLLaMA community 1mo ago

DeepSeek V4.1 Flash beats Astra on AA's new benchmark

https://artificialanalysis.ai/articles/artificial-analysis-intelligence-index-v4-3 AA shipped a new benchmark last week as part of the Intelligence Index v4.3 update — a brand-new private eval that replaces τ³. Astra was farming a ton of points on it and used those to get even…

27

r/LocalLLaMA community 1mo ago

Hoping for Optimized Smarter Upcoming Models .... Like DeepSeek-V4.1-Flash( KVCache + Engram) in Small/Medium/Big sizes

It's still a dream for many folks to run medium size(30B range) models @ Q8 with Unquantized KVCache (256K Context) on their GPUs. It would be awesome to have DeepSeek-V4.1-Flash's KVCache + Engram for all Upcoming models. Even for big models. Engram - Heard that approximately…

17

r/LocalLLaMA community 1mo ago

DS 4.1 and the new Harness

I gave DS V4.1 Flash an HLE problem with a bash tool + 2 hours. Hour 1: it wrote three MILP solvers. (225,200) Hour 2: it downloaded the HLE dataset from Hugging Face, found the question, read the answer key (225,600), and concluded its own answer (225,200) was better. I'm equal…

20

vLLM releases dev-tools 1mo ago

v0.29.1rc0

[watermarking] Dual-key gumbel-max watermarking for speculative decod…

20

r/LocalLLaMA community 1mo ago

Antirez Deepseek 4.1 flash gguf on HF

Q2 is there and Q4 is uploading as I type. Has his github been updated yet? How do you run this? https://huggingface.co/antirez/deepseek-v4.1-flash-gguf/tree/main   submitted by   /u/Queasy_Asparagus69 [link]   [comments]

34

Latent.Space news-outlet 1mo ago

[AINews] DeepSeek v4.1-Flash: 763B-P8B-D16B novel causal Encoder–Decoder architecture with vision marks the Return of the Whale

We agree with Sebastian: this should have been DeepSeek v5

14

r/LocalLLaMA community 1mo ago

Hot Expert Reload on GPU is what this community needs

A huge favor to ask llama maintainers - please implement this feature. Even with one 3090 card there will be tangible improvements in decode speed on MOE models with moderate number of active parameters, like Qwen3.8-Flash-Next, Deepseek V4/V4.1 Flash, GLM 5.3 Flash. With 2x…

38

ElevenLabs official-blog 1mo ago

Introducing Music v2.5, our best music model yet

ElevenLabs introduces Music v2.5, its best performing music model yet. Songs sound more layered and complex, with more natural-sounding instruments.

34

vLLM releases dev-tools 1mo ago

proto-v0.1.0

vllm-proto 0.1.0

16

ThursdAI news-outlet 1mo ago

OpenAI solves Navier-Stokes, Meta’s Muse a free AI agent that’s really good, DeepSeek V4.1 shrinks KV cache, and one doomer post causes OpenAI to consider pausing training + more AI news

Also a surprise announcement from CoreWeave and a free ticket code for ThursdAI listeners in SF on September 30th.

26

r/LocalLLaMA community 1mo ago

Someone apparently managed to kind of replicate what V4.1 flash does on KV for fast prefill on Qwen

I wonder someone will figure out a way to do this with 27B? Throw Qwen3 on this page for demo https://kishida.github.io/webdemos/llkvapprox/   submitted by   /u/T_rex2700 [link]   [comments]

10

ComfyUI releases dev-tools 1mo ago

v0.35.1

ComfyUI v0.35.1

6

r/LocalLLaMA community 1mo ago

CPU Only Experimental Sloppy Deepseek V4.1 Flash

Title says it all. https://github.com/gjabdelnoor/Day1DeepseekV4.1-CPU The goal is pretty simple, I like having infinite slow tokens from the bioinformatics machine in the lab to run overnight or over-week agentic jobs, paired with a watcher that kills it in 15 seconds if…

7

r/LocalLLaMA community 1mo ago

antirez working on DSV4.1 support for ds4

  submitted by   /u/backyard_tractorbeam [link]   [comments]

21

OpenAI Python SDK releases dev-tools 1mo ago

v3.13.0

3.13.0 (2026-09-10) Features api: add Agents API ( 1c4284a )

10

Anthropic SDK (Python) releases dev-tools 1mo ago

v1.5.0

1.5.0 (2026-09-10) Full Changelog: v1.4.0...v1.5.0 Features api: add auto mode tool permissions for Managed Agents ( 62aa21b ) api: add content_too_large web_fetch tool error code ( 4b5dec6 ) api: add the user-profiles-2026-09-04 beta value and external_user_details to user…

21