Raushan Turganbay 187439c3fa VLM: special multimodal Tokenizer (#34461) ... * kinda works * update * add tests * update * use special tokens in processors * typo * fix copies * fix * fix moshi after rebase * update * fix tests * update * Update docs/source/en/main_classes/tokenizer.md Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com> * update docs * test for load time adding tokens * fix some more tests which are now fetched better * one more fix --------- Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>		2024-11-04 16:37:51 +01:00
..
ar	[i18n-ar] Translated file : docs/source/ar/multilingual.md into Arabic (#33048)	2024-10-31 16:10:09 -07:00
de	Drop support for Python 3.8 (#34314)	2024-10-24 11:16:55 +02:00
en	VLM: special multimodal Tokenizer (#34461)	2024-11-04 16:37:51 +01:00
es	Trainer - deprecate tokenizer for processing_class (#32385)	2024-10-02 14:08:46 +01:00
fr	Trainer - deprecate tokenizer for processing_class (#32385)	2024-10-02 14:08:46 +01:00
hi	[i18n-HI] Translated accelerate page to Hindi (#34443)	2024-11-01 08:26:45 -07:00
it	Updated the custom_models.md changed cross_entropy code (#33118)	2024-08-26 13:15:43 +02:00
ja	Add image text to text pipeline (#34170)	2024-10-31 15:48:11 -04:00
ko	🌐 [i18n-KO] Translated model_doc/barthez.md to Korean (#33980)	2024-10-28 10:46:49 -07:00
ms	Remove old TF port docs (#30426)	2024-04-23 16:06:20 +01:00
pt	Trainer - deprecate tokenizer for processing_class (#32385)	2024-10-02 14:08:46 +01:00
te	Trainer - deprecate tokenizer for processing_class (#32385)	2024-10-02 14:08:46 +01:00
tr	Translate index.md to Turkish (#27093)	2023-11-08 08:35:20 -05:00
zh	Add image text to text pipeline (#34170)	2024-10-31 15:48:11 -04:00
_config.py	[#29174] ImportError Fix: Trainer with PyTorch requires accelerate>=0.20.1 Fix (#29888)	2024-04-08 14:21:16 +01:00