Raushan Turganbay 187439c3fa VLM: special multimodal Tokenizer (#34461) ... * kinda works * update * add tests * update * use special tokens in processors * typo * fix copies * fix * fix moshi after rebase * update * fix tests * update * Update docs/source/en/main_classes/tokenizer.md Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com> * update docs * test for load time adding tokens * fix some more tests which are now fetched better * one more fix --------- Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>		2024-11-04 16:37:51 +01:00
..
__init__.py	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
test_modeling_camembert.py	[RoBERTa-based] Add support for sdpa (#30510)	2024-08-28 10:26:00 +02:00
test_modeling_tf_camembert.py	Better TF docstring types (#23477)	2023-05-24 13:52:52 +01:00
test_tokenization_camembert.py	VLM: special multimodal Tokenizer (#34461)	2024-11-04 16:37:51 +01:00