Files
jiang1.li 82135ca498 [Bugfix][CPU] Fix GDN spec conv-state handling for short query lengths
A decode row without drafts stays a spec row (q_i=1) and keeps the
num_accepted offset left by its previous step. The fallback conv path
rolled the buffer assuming q_i == num_spec + 1, so B.copy_ hit a size
mismatch (6 vs 5); the native kernel makes the same assumption and
rejects num_accepted > seqlen. Roll as history+new tokens shifted left by
one (as the Triton kernel does) and only take the native path for
full-length rows. Exposed by the MRV2 warmup (#62888).
2026-10-23 13:41:31 +00:00
..