vLLM releases
44 articles archived · Visit source ↗ · RSS
-
vLLM releases dev-tools 3d ago
v0.28.1rc0
[Tools][Recipes] Improve sweep recommendations and short-alias parsin…
7 -
v0.28.0rc1
[kv_offload] fix(metrics): rename kv_offload_tiering_block_{queries,h…
23 -
v0.27.1: [CI] Limit Arctic import check to x86 test images
The arm64 test lockfile intentionally omits arctic-inference, so only validate its native extension on platforms where the package is installed. Co-authored-by: OpenAI Codex codex@openai.com Signed-off-by: khluu khluu000@gmail.com
19 -
v0.26.1rc0
[CI][ROCm] Fix test_ocp_mx_wikitext_correctness reference value ( #4 …
7 -
v0.25.0: [CI] Fix cargo-deny config flag ordering (#48170)
Signed-off-by: Lucas Wilkinson lwilkins@redhat.com
35 -
v0.25.0rc3
[P/D][Bugfix] Fix PD async KV load lookahead handling for MTP spec de…
6 -
v0.25.0rc2
Fix embed scaling + CUDA graphs in Transformers modelling backend ( #4 …
12 -
v0.25.0rc1
[CPU][Bugfix] Fix flaky ShortConv prefill test on ARM (uninitialized …
5 -
v0.24.0
[CI] Raise gsm8k startup timeout for MoE Refactor Qwen3 NVFP4 configs…
23 -
v0.23.1rc0: [Bugfix][CI] Update Dockerfile dependency graph PNG (#45602)
Signed-off-by: sfeng33 4florafeng@gmail.com
37 -
v0.22.1rc2: fix: resolve CUTLASS fmin compatibility for DeepSeek-V4 init
Signed-off-by: khluu khluu000@gmail.com
9 -
v0.22.1: fix: resolve CUTLASS fmin compatibility for DeepSeek-V4 init
Signed-off-by: khluu khluu000@gmail.com
28 -
v0.22.1rc1: [docker] Stop using extra-index-url for flashinfer-jit-cache (#44366)
Signed-off-by: Kevin H. Luu khluu000@gmail.com
34 -
v0.21.1rc0: [ROCm][CI] Stage B gating (#42025)
Signed-off-by: Andreas Karatzas akaratza@amd.com
17 -
v0.21.0
Highlights This release features 367 commits from 202 contributors (49 new)! Transformers v4 deprecated : This release formally deprecates transformers v4 support ( #40389 ). Users should migrate to transformers v5. C++20 build requirement : vLLM now requires a C++20-compatible…
23 -
v0.21.0rc3
[MLA Attention Backend] Add TOKENSPEED_MLA backend for DSR1/Kimi K25 …
28 -
v0.21.0rc2
[Bugfix] Install nvidia-cutlass-dsl[cu13] extra on CUDA 13 platforms …
16 -
v0.21.0rc1
[Build] Build bundled DeepGEMM _C per-Python so the wheel imports o…
7 -
v0.20.2
vLLM v0.20.2 Highlights This release features 6 commits from 6 contributors (0 new)! This is a small patch release with bug fixes for DeepSeek V4, gpt-oss, and Qwen3-VL Bug Fixes DeepSeek V4 sparse attention : Re-enable the persistent topk path on Hopper and ensure the memset…
11 -
v0.20.1
vLLM v0.20.1 This is a patch release on top of v0.20.0 primarily focused on DeepSeek V4 stabilization and performance improvements , along with several important bug fixes. DeepSeek V4 Base model support ( #41006 ). Multi-stream pre-attention GEMM ( #41061 ), configurable…
37 -
v0.20.2rc0: [MRV2] Add shutdown() method (#41297)
Signed-off-by: Woosuk Kwon woosuk@inferact.ai
35 -
v0.20.0
vLLM v0.20.0 Highlights This release features 752 commits from 320 contributors (123 new)! DeepSeek V4 : Initial DeepSeek V4 support landed ( #40860 ), with DSML token-leakage fix in DSV4/3.2 ( #40806 ), DSA + MTP IMA fix ( #40772 ), and a silu clamp limit on the shared expert (…
33 -
v0.20.1rc0: Add system_fingerprint field to OpenAI-compatible API responses (#40537)
Co-authored-by: Claude noreply@anthropic.com
6 -
v0.20.0rc1
Revert "[Misc] Move pyav and soundfile to common requirements" (#…
25 -
v0.19.1
This is a patch release on top of v0.19.0 with Transformers v5.5.3 upgrade and bug fixes for Gemma4: Update to transformers v5 ( #30566 ) [Bugfix] Fix invalid JSON in Gemma 4 streaming tool calls by stripping partial delimiters ( #38992 ) [Bugfix][Frontend] Fix Gemma4 streaming…
17 -
v0.19.2rc0: [Bugfix] Fix k_proj's bias for GLM-ASR (#40160)
Signed-off-by: Rishapveer Singh singhrishapveer@gmail.com
4
