Files
Raushan Turganbay 0291458166 [generation] Encode multimodal data only once (#45783)
* this works now

* better pass as dict, models have more keys

* qwen3-vl

* nits

* finally delete beam, not needed anymore!

* .

* all qwens

* fix repo

* more models

* t5 gemma

* gotta go now

* retuens and Idefics models

* qwen returns

* glm image, ig this works fine

* fix some models with greedy generation

* fix beam search

* fix repo

* fix tests again

* now it tests videos

* fix repo again after rebasing

* new models added while i was working

* videos

* fix the test

* make style

* fix repo

* .

* this

* lets make it BC for remote code

* save it before i forget

* style

* ugly but that is what we want, do smth with it tmrw

* a bit more

* .

* fix repo

* maybe just make non staticmethod

* please

* what is wrong with me, extra punctuation

* just why, pls run the CI

* or use a single keyword?

* this is annoying, run the CI pls

* fix some

* keep this for now

* renames

* more tests

* style

* tmp

* rename and new docstring

* type check

* revert unrelated

* conflicts every day :(

* use the helper with a check

* why so many new failures

* final fixes

* deepseek vl has real issues with testing

* style

* some of the comments

* initial attempt to address comments

* style

* trf

* fix some tests

* small test

* don't lose it

* more changes

* .

* fix these

* forgot about thsi comment

* fix alll except export

* glm image

* make style

* reveerted all?

* split the test

* fix repo and skip some tests

* wtf, failing ona main, fix i!

* please copy from qwen all new models!

* fix nemotron more

* guess this are all models, now sanity test

* fix diffusion gemma later, another enc-dec VLM

* diffusion gemma is not saved as `encoder_decoder` despite the arch - uses custom generation loop

* some of the comments

* ah enc-dec doesn't need it even, except florence

* move it around

* fail loud if both passed

* delete

* dibt error for these two, naming inconsistency across fn

* ci

* already broken `main`, needs update on expectations?

* fix repo

* align with runners
2026-09-28 19:40:41 +02:00
..