jiang1.li
82135ca498
[Bugfix][CPU] Fix GDN spec conv-state handling for short query lengths
...
A decode row without drafts stays a spec row (q_i=1) and keeps the
num_accepted offset left by its previous step. The fallback conv path
rolled the buffer assuming q_i == num_spec + 1, so B.copy_ hit a size
mismatch (6 vs 5); the native kernel makes the same assumption and
rejects num_accepted > seqlen. Roll as history+new tokens shifted left by
one (as the Triton kernel does) and only take the native path for
full-length rows. Exposed by the MRV2 warmup (#62888 ).
2026-10-23 13:41:31 +00:00
..
2026-10-22 11:56:18 +08:00
2026-10-22 22:21:12 +08:00
2026-10-22 15:25:45 +00:00
2026-10-22 22:18:09 -07:00
2026-09-16 16:44:29 +00:00
2026-10-09 14:22:31 -07:00
2026-10-22 09:34:55 +08:00
2026-10-23 04:58:34 +00:00
2026-10-22 23:27:19 +00:00
2026-10-23 07:30:02 +00:00
2026-10-21 10:55:26 -04:00
2026-10-09 15:12:03 +08:00
2026-09-16 16:44:29 +00:00
2026-10-08 00:11:59 +00:00
2026-10-23 13:41:31 +00:00
2026-10-22 10:59:53 +08:00
2026-10-23 04:51:57 +00:00
2026-10-23 18:35:14 +08:00
2026-10-22 06:57:08 +00:00
2026-10-22 17:00:09 +08:00
2026-10-12 10:41:07 -07:00
2026-10-15 12:54:21 -07:00
2026-10-22 04:00:51 +00:00
2026-10-22 13:48:48 -04:00
2026-10-22 12:45:26 -07:00
2026-10-22 18:14:12 +00:00
2026-10-22 01:20:28 +00:00
2026-10-22 07:26:05 +00:00
2026-09-16 16:44:29 +00:00
2026-10-12 10:11:26 -07:00
2026-10-22 17:00:09 +08:00
2026-10-22 17:00:09 +08:00
2026-10-22 12:45:26 -07:00
2026-10-19 21:19:35 +00:00
2026-09-30 04:39:03 +00:00
2026-10-22 14:56:35 -07:00
2026-10-23 13:18:13 +08:00
2026-10-23 17:42:35 +08:00
2026-09-16 16:44:29 +00:00
2026-10-23 16:23:12 +08:00
2026-10-21 10:02:57 +00:00
2026-09-16 16:44:29 +00:00
2026-10-14 15:10:35 +08:00
2026-10-08 09:56:19 +08:00
2026-10-13 10:17:14 +00:00
2026-09-16 10:57:24 -07:00
2026-10-22 17:51:11 -07:00
2026-10-19 02:36:29 +00:00
2026-10-21 16:55:58 +08:00
2026-06-16 15:16:45 +02:00
2026-04-10 08:29:35 +00:00
2026-10-01 09:11:46 +01:00
2026-08-26 21:00:54 +08:00
2026-10-07 08:35:14 +08:00
2026-09-23 22:32:36 -04:00
2026-10-23 05:45:15 +00:00
2026-08-11 04:33:10 +00:00
2026-08-28 23:11:50 +00:00
2026-09-16 10:57:24 -07:00
2026-05-09 19:47:09 -07:00
2026-10-22 17:00:09 +08:00
2026-10-05 14:37:13 -04:00
2026-08-11 04:33:10 +00:00
2026-09-27 22:23:46 -07:00
2026-10-01 09:11:46 +01:00
2026-09-27 22:23:46 -07:00
2026-10-15 00:23:50 -07:00
2026-10-06 13:12:19 +08:00
2026-10-11 09:57:07 -07:00