Marc Sun 9996277ca4 Remove deprecated data helpers (#49360) ...

* Remove deprecated GLUE/SQuAD/XNLI data helpers

These pre-`datasets` helpers (`GlueDataset`, `SquadDataset`, the GLUE/SQuAD/XNLI
processors and metrics) have been deprecated for years and have had no users in
the library since the legacy example scripts were removed in #41511.

- Delete `transformers.data.{datasets,processors,metrics}` and their top-level
  exports and dummy objects. The data collators are unchanged.
- Remove the slow GLUE evaluation test, `utils/download_glue_data.py` and the
  unused GermEval, STS-B and wiki_text fixtures.
- Drop the deprecated section of the processors docs page (en/ja/ko/zh) and the
  related entries in the repo consistency checks.

* remove deprecated data collator

2026-10-12 15:36:21 +00:00

..

__init__.py

Move test model folders (#17034)

2022-05-03 14:42:02 +02:00

test_modeling_bert.py

🚨 Validate config attributes (#41250)

2026-03-16 13:39:29 +00:00

test_tokenization_bert_legacy.py

Remove deprecated data helpers (#49360)

2026-10-12 15:36:21 +00:00

test_tokenization_bert.py

fix: decode() batch path respects self.clean_up_tokenization_spaces (#47793)

2026-09-01 07:02:06 +00:00