mirror of
https://github.com/huggingface/transformers.git
synced 2025-08-03 03:31:05 +06:00

* make MLukeTokenizerTest fast * make LukeTokenizerTest fast * add entry to _toctree.yaml
1 line
76 B
JSON
1 line
76 B
JSON
{"[MASK]": 0, "[UNK]": 1, "[PAD]": 2, "DUMMY": 3, "DUMMY2": 4, "[MASK2]": 5} |