vLLM releases
69 articles archived · Visit source ↗ · RSS
-
vLLM releases dev-tools 12d ago
v0.31.0rc4
[Bugfix][HiSparse] Fix MTP acceptance collapse under FULL graphs with…
31 -
v0.31.0rc2
[Bugfix][Mamba] Keep the prompt-end prefill checkpoint under sparse r…
6 -
v0.30.0rc2
[Bugfix][NIXL] Avoid receive reports for notification-only requests (…
22 -
proto-v0.2.0: vllm-proto 0.2.0
Validated by PR #56538 CI at fa2a26f .
23 -
v0.29.1rc0
[watermarking] Dual-key gumbel-max watermarking for speculative decod…
20 -
v0.29.0rc6
[Bugfix][Core] Apply dense prefix cache default to hybrid models ( #55 …
36 -
v0.29.0
[Bugfix][Core] Apply dense prefix cache default to hybrid models ( #55 …
37 -
v0.29.0rc5
[Core] Default prefix_cache_retention_interval to dense for Mamba + E…
23 -
v0.29.0rc4: [Bugfix] Avoid sync in TRT-LLM ragged prefill
Generated-by: Codex codex@openai.com Signed-off-by: Codex codex@openai.com
16 -
v0.29.0rc3
[CI] Remove deleted nvidia/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-BF1…
33 -
v0.29.0rc2
[Bugfix][Multimodal] Handle prefix-covered items in SHM worker cache …
9 -
v0.29.0rc1: [Bugfix] Handle padded routes in CUTLASS MoE permutations (#54747)
Signed-off-by: Kevin Luu 51931015+khluu@users.noreply.github.com Signed-off-by: Yongye Zhu zyy1102000@gmail.com Co-authored-by: Codex codex@openai.com Co-authored-by: Yongye Zhu zyy1102000@gmail.com
23 -
v0.28.1rc0
[Tools][Recipes] Improve sweep recommendations and short-alias parsin…
7 -
v0.28.0rc1
[kv_offload] fix(metrics): rename kv_offload_tiering_block_{queries,h…
23 -
v0.27.1: [CI] Limit Arctic import check to x86 test images
The arm64 test lockfile intentionally omits arctic-inference, so only validate its native extension on platforms where the package is installed. Co-authored-by: OpenAI Codex codex@openai.com Signed-off-by: khluu khluu000@gmail.com
19 -
v0.26.1rc0
[CI][ROCm] Fix test_ocp_mx_wikitext_correctness reference value ( #4 …
7 -
v0.25.0: [CI] Fix cargo-deny config flag ordering (#48170)
Signed-off-by: Lucas Wilkinson lwilkins@redhat.com
35 -
v0.25.0rc3
[P/D][Bugfix] Fix PD async KV load lookahead handling for MTP spec de…
6 -
v0.25.0rc2
Fix embed scaling + CUDA graphs in Transformers modelling backend ( #4 …
12 -
v0.25.0rc1
[CPU][Bugfix] Fix flaky ShortConv prefill test on ARM (uninitialized …
5 -
v0.24.0
[CI] Raise gsm8k startup timeout for MoE Refactor Qwen3 NVFP4 configs…
23 -
v0.23.1rc0: [Bugfix][CI] Update Dockerfile dependency graph PNG (#45602)
Signed-off-by: sfeng33 4florafeng@gmail.com
37 -
v0.22.1rc2: fix: resolve CUTLASS fmin compatibility for DeepSeek-V4 init
Signed-off-by: khluu khluu000@gmail.com
9 -
v0.22.1: fix: resolve CUTLASS fmin compatibility for DeepSeek-V4 init
Signed-off-by: khluu khluu000@gmail.com
28