 Louie Tsai
|
115b59a2da
|
[Recipes Tool] Fix TP auto-detection for heterogeneous per-layer attention models (#63857)
Signed-off-by: louie-tsai <louie.tsai@intel.com>
|
2026-10-27 17:28:59 +08:00 |
|
|
|
6fe3d447ac
|
[CI][AMD] Mirror ReplaySSM, MiniMax-M3 attention kernels and Kimi K3 prefix cache on MI355 (#62141)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Andreas Karatzas <AndreasKaratzas@users.noreply.github.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Andreas Karatzas <AndreasKaratzas@users.noreply.github.com>
Co-authored-by: vllm-agent <claw@inferact.ai>
|
2026-10-26 23:13:38 -05:00 |
|
|
|
967c39f89e
|
[CI] List one test path per line in Buildkite pytest commands to avoid merge conflicts (#63408)
Signed-off-by: Oxana Korzh <okorzh@amd.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: vllm-agent <claw@inferact.ai>
|
2026-10-26 16:15:29 -07:00 |
|
|
Artem Perevedentsev
|
938be2d83d
|
[Tool Calling] Migrate llama3_json parser to parser engine (#63569)
Signed-off-by: Artem Perevedentsev <aperevedents@nvidia.com>
|
2026-10-26 22:30:20 +00:00 |
|
|
Kevin H. Luu
|
f8c12c212a
|
[CI] Disable jobs with unpinned runtime installs (#63609)
Signed-off-by: khluu <khluu000@gmail.com>
|
2026-10-25 12:40:35 -07:00 |
|
|
Kevin H. Luu
|
9d48c8ab95
|
[CI] Disable jobs with unlocked transitive dependencies (#63608)
Signed-off-by: khluu <khluu000@gmail.com>
|
2026-10-25 12:30:06 -07:00 |
|
|
|
debcf22843
|
[CI][ROCm] Export kernel source maps for CI selection (#59100)
Signed-off-by: Andreas Karatzas <andreas.karatzas@protonmail.com>
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Andreas Karatzas <AndreasKaratzas@users.noreply.github.com>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Andreas Karatzas <AndreasKaratzas@users.noreply.github.com>
|
2026-10-23 18:05:23 -07:00 |
|
|
|
1e330b1019
|
[MyPy][5/N] Fix mypy errors in hard tests/ dirs and enforce follow-imports=silent (#62142)
Signed-off-by: adarshxs <adarsh.shirawalmath@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-20 15:30:21 -07:00 |
|
|
|
cc8a41f328
|
[MyPy][4/N] Fix mypy errors in medium-hard tests/ dirs (#55485)
Signed-off-by: Satvik Shrivas <44926681+theSatvik@users.noreply.github.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-10-20 04:51:15 -07:00 |
|
|
|
e10ecb6bd6
|
[Bugfix][DCP] Support strided LSE in direct A2A reduction (#60373)
Signed-off-by: John-Evan Karcenty <jkarcenty@yokbvdijkarcenty01.nvidia.com>
Co-authored-by: John-Evan Karcenty <jkarcenty@yokbvdijkarcenty01.nvidia.com>
Co-authored-by: Wei Zhao <51183510+wzhao18@users.noreply.github.com>
|
2026-10-19 22:09:39 -04:00 |
|
|
Mritunjay Kumar SharmaandClaude Opus 5.5
|
04631c4915
|
[Security][CI/Build] Add pre-commit check for hardcoded trust_remote_code=True (#62547)
Signed-off-by: Mritunjay Sharma <mritunjaysharma394@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-19 21:19:35 +00:00 |
|
|
wang.yuqi
|
5caabdbb65
|
[Frontend] Consolidate startup utils. (#62390)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
|
2026-10-19 16:00:10 +00:00 |
|
|
aoshen02andClaude Opus 5.5
|
2365177ddd
|
[Doc][RL] Document the weight-transfer HTTP protocol for trainers without vLLM (#62267)
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-18 09:26:56 +00:00 |
|
|
|
83c9a547bf
|
[CI][Release] Fix release wheel builds: stop excluding tracked recipes/ from Docker context (#62221)
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: vllm-agent <claw@inferact.ai>
|
2026-10-18 00:48:00 -07:00 |
|
|
|
b2456c622b
|
[ROCm][CI] Make ROCm 10.0 the default image; keep ROCm 7.2 as -rocm72 (#58761)
Signed-off-by: Rohan Potdar <rohan.potdar@amd.com>
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Micah Williamson <micah.williamson@amd.com>
Co-authored-by: Kevin H. Luu <khluu000@gmail.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-10-17 21:43:59 -05:00 |
|
|
|
9eb7fb9157
|
[Build] Remove unused tools/install_deepgemm.sh (#61265)
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: Misha Goin <mgoin64@gmail.com>
Co-authored-by: Kevin H. Luu <khluu000@gmail.com>
|
2026-10-16 15:57:49 -04:00 |
|
|
Jee Jee Li
|
bee95149e2
|
Update DeepGEMM commit (#61744)
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
|
2026-10-15 17:54:40 -07:00 |
|
|
Woosuk KwonandClaude Opus 5.5
|
e57bb4ace7
|
[Core] Remove the legacy Ray compiled-graph executor (#61712)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-14 18:13:27 -07:00 |
|
|
Micah Williamson
|
a4d553a46a
|
Revert "[Build] Update deep_gemm git tag for locality_domain update" (#61703)
|
2026-10-14 14:57:44 -07:00 |
|
|
Chris LeonardandShengqi Chen
|
ded7ae35e5
|
[Build] Update deep_gemm git tag for locality_domain update (#61491)
Signed-off-by: Chris Leonard <chleonar@redhat.com>
Signed-off-by: Shengqi Chen <harry-chen@outlook.com>
Co-authored-by: Shengqi Chen <harry-chen@outlook.com>
|
2026-10-14 15:41:16 -04:00 |
|
|
Nick HillandClaude Opus 5.5
|
78b32b3fdc
|
Revert "[Build] DeepGEMM migration to torch Stable ABI (#59482)" (#61510)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
|
2026-10-13 15:33:50 -07:00 |
|
|
Chris LeonardandShengqi Chen
|
f5fefbffe5
|
[Build] DeepGEMM migration to torch Stable ABI (#59482)
Signed-off-by: Chris Leonard <chleonar@redhat.com>
Signed-off-by: Shengqi Chen <harry-chen@outlook.com>
Co-authored-by: Shengqi Chen <harry-chen@outlook.com>
|
2026-10-13 08:01:44 -07:00 |
|
|
Yongye ZhuandClaude Opus 5.5
|
a6009ea85b
|
[Kernel][Build] Bump DeepGEMM to the 26/09/30 release and adapt the sparse indexer (#61149)
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
|
2026-10-12 23:24:43 -07:00 |
|
|
Misha GoinandClaude
|
d79b52b182
|
[Misc] Consolidate csrc shared headers and prune dead code (#60721)
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-10-12 09:46:22 -07:00 |
|
|
|
04b02fc8a5
|
[Core] shm tensor arena for efficient cpu->gpu worker broadcast (#51207)
Signed-off-by: Bolin Sun <bolins@nvidia.com>
Signed-off-by: <bolins@nvidia.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
|
2026-10-09 16:13:24 -07:00 |
|
|
Misha GoinandClaude
|
3766a67a32
|
[WideEP] Explain how to fix a too-old NCCL for DeepEP v2 (#60449)
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-10-09 12:34:58 -07:00 |
|
|
Li, Jiang
|
9adba10f3f
|
[Bugfix] Fix pre-commit check (#60840)
Signed-off-by: jiang1.li <jiang1.li@intel.com>
|
2026-10-09 12:48:32 +00:00 |
|
|
Louie Tsai
|
196483e25b
|
[Tools] Recipes sweep workflow (#57307)
Signed-off-by: louie-tsai <louie.tsai@intel.com>
|
2026-10-09 19:44:09 +08:00 |
|
|
Harry MellorandClaude Opus 5.5
|
21d9758459
|
Remove Python 3.10 support now that it is EOL (#60402)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-08 02:30:52 -07:00 |
|
|
Artem Perevedentsev
|
4ac5a36a8e
|
[CI/Build][NVIDIA] Build NIXL with NIXL EP from source in Rubin image (#60090)
Signed-off-by: Artem Perevedentsev <aperevedents@nvidia.com>
|
2026-10-08 02:44:17 +04:00 |
|
|
|
42ecc8eebe
|
[CI][RL] Consolidate RL entrypoint tests under tests/entrypoints/rl (#59948)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-07 08:29:09 +00:00 |
|
|
Turner JabbourandClaude Sonnet 5
|
aecb717f10
|
[CI] Allowlist-shrink batch 2: wire 9 tests/models/ files into Buildkite, fix 2 stale bugs found (#59050)
Signed-off-by: Turner Jabbour <doubleujabbour@gmail.com>
Co-authored-by: Claude Sonnet 5 <noreply@anthropic.com>
|
2026-10-06 21:16:53 -07:00 |
|
|
Chris LeonardandShengqi Chen
|
cc73cca9c8
|
[Build] Migrate vendored DeepGEMM from pybind to TORCH_LIBRARY (abi3) (#48962)
Signed-off-by: Chris Leonard <chleonar@redhat.com>
Co-authored-by: Shengqi Chen <harry-chen@outlook.com>
|
2026-10-06 08:39:04 -07:00 |
|
|
Louie Tsai
|
888074b42d
|
[CPU][Recipes] Detect model head constraints for automatic tensor parallel selection in vLLM Recipes Tool (#60170)
Signed-off-by: louie-tsai <louie.tsai@intel.com>
|
2026-10-06 18:15:40 +08:00 |
|
|
Bugen ZhaoandClaude Opus 5.5
|
b3082d3044
|
[Rust Frontend] Remove the PyO3 tool-parser bridge (#59744)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-06 05:46:27 +00:00 |
|
|
Misha GoinandClaude
|
1ab18599ca
|
[Agents] Add pre-commit check for agent files and skills (#59657)
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-10-02 09:38:22 -07:00 |
|
|
Turner JabbourandClaude Sonnet 5
|
e2cb5ee46c
|
[CI] Replace shellcheck-suppressed patterns flagged in #52572 with clean equivalents (#53341)
Signed-off-by: Turner Jabbour <doubleujabbour@gmail.com>
Co-authored-by: Claude Sonnet 5 <noreply@anthropic.com>
|
2026-10-02 11:30:04 +00:00 |
|
|
Harry MellorandClaude Opus 5.5
|
7b44aad5db
|
[MyPy] Fix mypy errors in vllm/model_executor/models/[kK]* (#59402)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-01 19:32:27 +00:00 |
|
|
Andrii SkliarandAndrii Skliar
|
deb148e730
|
[Mamba] Add FlashInfer ReplaySSM support for MTP (#52928)
Signed-off-by: Andrii Skliar <askliar@nvidia.com>
Co-authored-by: Andrii Skliar <askliar@nvidia.com>
|
2026-09-30 21:41:17 +00:00 |
|
|
|
5225f1bacb
|
[MyPy][3/N] Fix MyPy errors in test groups (part 3) (#55939)
Signed-off-by: Taimys <ffy2281693949@gmail.com>
Signed-off-by: Luyi Xiao <81631911+luyixiao95@users.noreply.github.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: Luyi Xiao <81631911+luyixiao95@users.noreply.github.com>
Co-authored-by: Taimys <ffy2281693949@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-09-30 11:06:07 +00:00 |
|
|
|
5dd693122c
|
[MyPy][2/N] Fix mypy errors in small tests/ dirs (#51043)
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-09-29 21:27:45 +01:00 |
|
|
|
9a190f142c
|
[Mypy] Fix mypy typing for Zamba2 models (#58255)
Signed-off-by: Ashraf Bhuiyan <mbhuiyan@redhat.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-09-29 18:13:52 +00:00 |
|
|
Ashraf BhuiyanandWentao Ye
|
2454b5a4f0
|
[Mypy] Fix mypy typing for Whisper models (#58254)
Signed-off-by: Ashraf Bhuiyan <mbhuiyan@redhat.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
|
2026-09-29 17:10:28 +01:00 |
|
|
Ashraf BhuiyanandWentao Ye
|
2619b6b72b
|
[Mypy] Fix mypy typing for Voxtral and vision models (#58251)
Signed-off-by: Ashraf Bhuiyan <mbhuiyan@redhat.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
|
2026-09-28 15:52:50 -04:00 |
|
|
Louie Tsai
|
ccfd1cea75
|
[CPU] Include vLLM Recipes tooling in release image to deploy models using vLLM Recipes (#58796)
Signed-off-by: louie-tsai <louie.tsai@intel.com>
|
2026-09-28 16:46:53 +08:00 |
|
|
Turner JabbourandClaude Sonnet 5
|
2407f405b5
|
[CI] Allowlist-shrink batch 1: wire 17 root-level tests + drop 5 stale watermarking entries into misc.yaml (#58055)
Signed-off-by: Turner Jabbour <doubleujabbour@gmail.com>
Co-authored-by: Claude Sonnet 5 <noreply@anthropic.com>
|
2026-09-27 22:23:46 -07:00 |
|
|
Ashraf Bhuiyan
|
b9e2903b89
|
[Mypy] Fix mypy typing for Ultravox and Unlimited-OCR models (#58239)
Signed-off-by: Ashraf Bhuiyan <mbhuiyan@redhat.com>
|
2026-09-27 21:19:04 -04:00 |
|
|
Ashraf Bhuiyan
|
5113cf9d16
|
[Mypy] Fix mypy typing for Qwen and Qianfan models (#58046)
Signed-off-by: Ashraf Bhuiyan <mbhuiyan@redhat.com>
|
2026-09-26 14:31:51 +00:00 |
|
|
Misha Goin
|
58aa2f1ef1
|
[Refactor] Move auxiliary files out of the repository root (#58572)
Signed-off-by: mgoin <mgoin64@gmail.com>
|
2026-09-24 12:38:56 -07:00 |
|
|
Harry MellorandClaude Opus 5.5
|
d881812500
|
[Chore] Use Transformers v5 names and drop redundant processor use_fast (#58550)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
|
2026-09-24 14:14:10 +00:00 |
|