Anton VlasjukandCyril Vallez e91f7ef4d3 🚨 [Kernels] Refactor all linear attn models & native kernels fallback (#47630) ...

* kernel native

* fix warning

* have to fix other modular to be coherent

* remove useless

* use native lib as well

* modular

* combine them

* doc

* ignore kwargs, allow og

* fix

* gdn like paths (missing conv of olmo hybrid)

* olmo hybrid fused conv style

* fix

* fix

* poc mamba2, kernel must compile but torch seems to match

* kernels match --> hf kernels will be needed

* style

* quick fixes

* mamba2 works

* mamba2 suite of models

* oops

* conv1ds across other models

* let's try this

* mamba base implementation

* fixups as per review comments

* fixup mamba tests and other issues

* make no shape check by default (single padded sample should also work)

* remove todo

* propogate mamba1

* style

* fix mambapy + enable on jamba

* zamba1

* style

* fix early cast (leads to non fp32 norm)

* fix padding free path

* fix offload

* bump kernels

* remove todo

* avoid onnx export and fix mamba2 test

* fix bamba test

* update falcon mamba - aligned with all other devices

* oops

* adress review

---------

Co-authored-by: Cyril Vallez <cyril.vallez@gmail.com>

2026-08-05 09:33:35 +00:00

..

__init__.py

Add the Bamba Model (#34982)

2024-12-18 20:18:17 +01:00

test_modeling_bamba.py

🚨 [Kernels] Refactor all linear attn models & native kernels fallback (#47630)

2026-08-05 09:33:35 +00:00