14934 Commits
Author SHA1 Message Date
Chunan ZengandClaude Opus 5.5 f2d3188925 [Perf] moe: Fold the routed scaling factor into the mega MoE pre-dispatch (#46090)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-28 17:46:43 -07:00
0fdc4e82ca [Feat] rust-server: Carry customized_info through the native /generate frontend (#46949)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
Co-authored-by: shodoco <shodoco@users.noreply.github.com>
2026-10-28 17:41:46 -07:00
Liangsheng YinandQiaolin-Yu c10e0e1773 [Refactor] spec: Make ForwardBatch the single channel for the ragged-verify layout (#34031)
Co-authored-by: Qiaolin-Yu <liin1211@outlook.com>
2026-10-28 16:37:36 -07:00
f5c23b4769 [Fix] rust_server: Record startup-time metrics in Rust mode (#47114)
Co-authored-by: metamergebot <324680979+metamergebot@users.noreply.github.com>
Co-authored-by: shodoco <shodoco@users.noreply.github.com>
2026-10-28 16:24:23 -07:00
Glen Liu 6b697b9aad [Perf] LoRA: bound csgmv CUDA-graph segment grids by token count (#46743) 2026-10-28 16:12:15 -07:00
Liangsheng Yin 76d5b3ce02 [Perf] dsv41: Run MegaGate routing in prefill (#47148) 2026-10-28 15:53:36 -07:00
Liangsheng Yin 88fea372d4 [Fix] dsv4: Capture the replay tail thread-locally while serving (#47146) 2026-10-28 15:01:55 -07:00
Liangsheng Yin e105742296 [Fix] linker: Order loads behind the forward that may still use the pages (#45580) 2026-10-28 14:29:01 -07:00
Liangsheng Yin 54d2f65540 [Perf] dsv41: Read Engram rows in place by default for GPU tables over NVLink (#47033) 2026-10-28 13:28:47 -07:00
Liangsheng Yin 1825a09dbb [Perf] dsv41: Use the Engram all-to-all lookup for decode and CUDA graphs (#46955) 2026-10-28 13:25:00 -07:00
YAMYandOasis-Git e1b6d7581e [Feat] [NVIDIA] runtime: Add a master switch for megakernel runtime optimizations (#47105)
Co-authored-by: Oasis-Git <ayw.sirius19@gmail.com>
2026-10-28 12:19:43 -07:00
Michael 5ac32ada54 [Test] [AMD] diffusion: Compute the VAE blend test's fp16 reference in fp32 on ROCm (#46889) 2026-10-28 10:23:39 -07:00
Avaya Aggarwal 4517a5ff1b [Fix] comfyui: Reject conditioning kwargs the SGLD adapters silently drop (#46286) 2026-10-28 23:14:47 +08:00
Avaya AggarwalandWenhaoZhang b1c6945659 [Feat] comfyui: Add SGLDWorkerStatus diagnostics node (#43697)
Co-authored-by: WenhaoZhang <42087078+niehen6174@users.noreply.github.com>
2026-10-28 23:14:35 +08:00
Shangming CaiandClaude Opus 5.5 ff96d43008 [Fix] ci: Repair main after the #39728/#46990 merge race and RUSTSEC-2026-0414 (#47078)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-28 23:11:21 +08:00
Cheng Wan 5cc9c933fc [Fix] mem_cache: support prefix commits in unified MHA views (#47071) 2026-10-28 05:17:22 -07:00
Cheng Wan e028ee40b0 [Refactor] cache: Build prefix-tree components from storage slots (#46991) 2026-10-28 05:04:43 -07:00
Cheng Wan d5bc823ad5 [Refactor] attention: Use typed KV views and shared layer routing (#46990) 2026-10-28 05:04:16 -07:00
Cheng Wan 146378629d [Refactor] kv-cache: Share storage interfaces across runtime consumers (#46989) 2026-10-28 05:03:48 -07:00
Cheng Wan 53592ea5ff [Refactor] kv-cache: Centralize request rows and allocation lifecycle (#46988) 2026-10-28 05:03:23 -07:00
Cheng Wan ca8184e13a [Refactor] kv-cache: Separate byte storage from allocation identities (#46987) 2026-10-28 05:02:46 -07:00
Cheng Wan 240862923e [Refactor] mem-cache: Bind fused drafts to routed KV views (#46986) 2026-10-28 05:02:08 -07:00
Cheng Wan eb79ecca11 [Refactor] mem-cache: Track transfer pins at allocator boundaries (#46985) 2026-10-28 05:01:43 -07:00
Cheng Wan f80cb3a2fd [Refactor] mem-cache: Replace unified pool variants with a routed cache (#46984) 2026-10-28 05:01:17 -07:00
Cheng Wan 14fea75124 [Fix] [AMD] attention: Avoid fused writes to translated window storage (#46983) 2026-10-28 05:00:50 -07:00
Cheng Wan 298b563596 [Refactor] mem-cache: Build cache transfers from storage plans (#46982) 2026-10-28 05:00:25 -07:00
Cheng Wan 1721c099f9 [Fix] hicache: Build hybrid recurrent host pools consistently (#46981) 2026-10-28 04:59:59 -07:00
Cheng Wan 306a699a60 [Refactor] mem-cache: Centralize recurrent state ownership and access (#46980) 2026-10-28 04:59:34 -07:00
Cheng Wan 3b597cb76d [Refactor] mem-cache: Route layer access through KV subpool views (#46979) 2026-10-28 04:59:08 -07:00
Cheng Wan cf3d21b0c9 [Refactor] mem-cache: Describe KV address translation with ID spaces (#46978) 2026-10-28 04:58:30 -07:00
Cheng Wan 5f6075fa2f [Refactor] mem_cache: Centralize unified KV capacity pricing and admission (#46977) 2026-10-28 04:58:06 -07:00
Cheng Wan ccc71fa514 [Refactor] mem_cache: Use one allocator for unified KV sub-pools (#46976) 2026-10-28 04:57:40 -07:00
Cheng Wan 3355d668ce [Fix] mem_cache: Forward HiCache completion events to recurrent state (#46975) 2026-10-28 04:57:00 -07:00
Cheng Wan 5433093d83 [Refactor] mem_cache: Build unified KV pools from layer declarations (#46974) 2026-10-28 04:54:43 -07:00
Cheng Wan 335682058a [Refactor] mem_cache: Separate unified KV layout specifications (#46973) 2026-10-28 04:54:07 -07:00
Rain Jiang 69233a4622 [Feat] rust-server: Fan control requests out to every DP rank (#46181) 2026-10-28 04:53:40 -07:00
Cheng Wan 8044ed4e28 [Fix] mem_cache: Reject unsupported int8 checkpoints with unified memory (#46972) 2026-10-28 04:52:10 -07:00
Cheng Wan 77936f7b25 [Fix] mem_cache: Preserve convolution slice axis in unified hybrid pools (#46971) 2026-10-28 04:51:00 -07:00
Cheng Wan ddf24c4d17 [Test] mem_cache: Add unified KV layout and allocator regression coverage (#46970) 2026-10-28 04:49:58 -07:00
iridiumine f59cc7e45f [Perf] [NPU] dsv4: drop host-syncing ops from the decode scheduler chain (aclnnNonzeroV2 + D2H) (#46805) 2026-10-28 19:28:23 +08:00
MickandMick Qian e0df901d68 [Fix] diffusion/ci: Keep final failure reasons at the end of shard logs (#46916)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-10-28 18:59:56 +08:00
Monishver 73fbf5ccd3 [Perf] speculative: Rotate multi-layer EAGLE prefill input_ids 4096 ids per trip, not 8 (#46639)
Signed-off-by: Monishver Chandrasekaran <monishverchandrasekaran@gmail.com>
2026-10-28 03:20:40 -07:00
Olga Miroshnichenko 86f72e5b5c [Fix] [AMD] memory_pool: Keep K and V in separate allocations on ROCm (#46861) 2026-10-28 03:06:15 -07:00
Eric.Chin.AMDandThomas Wang edd270fd69 [Feat] [AMD] dsa: Enable DCP on the triton sparse-MLA backend (#44322)
Co-authored-by: Thomas Wang <thomawan@amd.com>
2026-10-28 02:45:44 -07:00
f65af1cd83 [Feat] HiCache: Page unified e2e integration (#39728)
Co-authored-by: huangtingwei <141888744+huangtingwei9988@users.noreply.github.com>
Co-authored-by: Zhangheng <hzh0425@apache.org>
2026-10-28 17:39:30 +08:00
AMD-yanfeiwang b85d6a8893 [Feat] [AMD] mori: Allow MoRI for DeepSeek-V4.1 DSpark PD (#42457) 2026-10-28 02:25:59 -07:00
aa8e0a9b6a [Fix] [AMD] dsa: Limit AITER decode metadata to the active batch (#41696)
Co-authored-by: Pawel Kowalski <pawel.kowalski@silo.ai>
Co-authored-by: Jacob0226 <Jacob.CHANG@amd.com>
2026-10-28 02:15:49 -07:00
Aarne Talman c6c7533957 [Perf] batch-invariant: Fused residual add + RMSNorm kernel (#46159) 2026-10-28 02:03:06 -07:00
Aarne Talman 1e7e19285d [Perf] [AMD] batch-invariant: Tune the bf16 matmul for gfx950 (#44045)
Signed-off-by: Aarne Talman <aarne.talman@amd.com>
2026-10-28 01:51:49 -07:00
Liangsheng Yin c240169265 [Fix] custom-all-reduce: Keep integer all-reduces off the custom all-reduce kernels (#46994) 2026-10-28 01:15:28 -07:00