SaulLu 7b8bdd8601 fix the tokenizer_config.json file for the slow tokenizer when a fast version is available (#15319) ... * add new test * update test * remove `tokenizer_file` from `additional_files_names` in `tokenization_utils_base.py` * add `tokenizer_file` for the fast only tokenizer * change global variables layoutxml * remove `"tokenizer_file"` from DPR tokenizer's Global variables * remove `tokenizer_file` from herbert slow tokenizer init * `"tokenizer_file"` from LED tokenizer's Global variables * remove `tokenizer_file` from mbart slow tokenizer init * remove `tokenizer_file` from slow tokenizer template * adapt to versioning * adapt the `test_tokenizer_mismatch_warning` test * clean test * clarify `VOCAB_FILES_NAMES` in tokenization_utils_fast.py * Revert "remove `tokenizer_file` from mbart slow tokenizer init" This reverts commit 0dbb723fa9. * Revert "`"tokenizer_file"` from LED tokenizer's Global variables" This reverts commit 5a3f879bdd. * Revert "remove `tokenizer_file` from herbert slow tokenizer init" This reverts commit f5e10007b7. * Revert "remove `"tokenizer_file"` from DPR tokenizer's Global variables" This reverts commit da0895330b. * set `tokenizer_file` in super `__init__` of mbart		2022-02-01 16:48:25 +01:00
..
adding_a_new_example_script	Happy New Year! (#15094)	2022-01-10 12:05:57 -05:00
adding_a_new_model	fix the tokenizer_config.json file for the slow tokenizer when a fast version is available (#15319)	2022-02-01 16:48:25 +01:00