transformers/tests/fixtures
Ryokan RI 824fd44fc3
Feature/fix slow test in mluke (#14749)
* make MLukeTokenizerTest fast

* make LukeTokenizerTest fast

* add entry to _toctree.yaml
2021-12-22 06:35:59 -05:00
..
tests_samples Fix img classification tests (#13456) 2021-09-07 05:58:45 -04:00
dummy_feature_extractor_config.json [AutoProcessor] Add Wav2Vec2WithLM & small fix (#14675) 2021-12-08 15:51:28 +01:00
dummy-config.json
empty.txt
input.txt
merges.txt [AutoTokenizer] Allow creation of tokenizers by tokenizer type (#13668) 2021-09-22 00:29:38 +02:00
preprocessor_config.json Auto processor (#14465) 2021-11-22 12:17:38 -05:00
sample_text_no_unicode.txt [Dependencies|tokenizers] Make both SentencePiece and Tokenizers optional dependencies (#7659) 2020-10-18 20:51:24 +02:00
sample_text.txt
spiece.model
test_entity_vocab.json Feature/fix slow test in mluke (#14749) 2021-12-22 06:35:59 -05:00
test_sentencepiece_bpe.model Conversion from slow to fast for BPE spm vocabs contained an error. (#10120) 2021-02-13 08:24:53 -05:00
test_sentencepiece_no_bos.model
test_sentencepiece.model
vocab.json [AutoTokenizer] Allow creation of tokenizers by tokenizer type (#13668) 2021-09-22 00:29:38 +02:00
vocab.txt [AutoTokenizer] Allow creation of tokenizers by tokenizer type (#13668) 2021-09-22 00:29:38 +02:00