4 Commits

Author	SHA1	Message	Date
Patrick von Platen	1bfa347707	[Tests] Speed up tokenizer tests (#14964) ... * speed up canine and mluke * speed up mbart and mbart50 toks * upload files	2021-12-28 17:02:50 +01:00
Ryokan RI	824fd44fc3	Feature/fix slow test in mluke (#14749) ... * make MLukeTokenizerTest fast * make LukeTokenizerTest fast * add entry to _toctree.yaml	2021-12-22 06:35:59 -05:00
Sylvain Gugger	e6219320b9	Make MLuke tokenizer tests slow (#14690)	2021-12-08 15:59:57 -05:00
Ryokan RI	30646a0a3c	Add mLUKE (#14640) ... * implement MLukeTokenizer and LukeForMaskedLM * update tests * update docs * add LukeForMaskedLM to check_repo.py * update README * fix test and specify the entity pad id in tokenization_(m)luke * fix EntityPredictionHeadTransform	2021-12-07 00:25:28 -05:00