Raushan Turganbay 187439c3fa VLM: special multimodal Tokenizer (#34461) ... * kinda works * update * add tests * update * use special tokens in processors * typo * fix copies * fix * fix moshi after rebase * update * fix tests * update * Update docs/source/en/main_classes/tokenizer.md Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com> * update docs * test for load time adding tokens * fix some more tests which are now fetched better * one more fix --------- Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>		2024-11-04 16:37:51 +01:00
..
__init__.py	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
test_modeling_rembert.py	update ruff version (#30932)	2024-05-22 06:40:15 +02:00
test_modeling_tf_rembert.py	Speed up TF tests by reducing hidden layer counts (#24595)	2023-06-30 16:30:33 +01:00
test_tokenization_rembert.py	VLM: special multimodal Tokenizer (#34461)	2024-11-04 16:37:51 +01:00