Arthur 30b3c46ff5 [split_special_tokens] Add support for split_special_tokens argument to encode (#25081) ... * draft changes * update and add tests * styling for no * move test * path to usable model * update test * small update * update bertbased tokenizers * don'tuse kwargs for _tokenize * don'tuse kwargs for _tokenize * fix copies * update * update test for special tokenizers * fixup * skip two tests * remove pdb breakpiont() * wowo * rewrite custom tests * nits * revert chang in target keys * fix markup lm * update documentation of the argument		2023-08-18 13:26:27 +02:00
..
__init__.py	Add MarkupLM (#19198)	2022-09-30 08:25:43 +02:00
test_feature_extraction_markuplm.py	Add MarkupLM (#19198)	2022-09-30 08:25:43 +02:00
test_modeling_markuplm.py	CI with num_hidden_layers=2 🚀🚀🚀 (#25266)	2023-08-02 20:22:36 +02:00
test_processor_markuplm.py	Update some MarkupLM tests' expected values (#22667)	2023-04-11 10:00:34 +02:00
test_tokenization_markuplm.py	[split_special_tokens] Add support for split_special_tokens argument to encode (#25081)	2023-08-18 13:26:27 +02:00