transformers/tests
Sam Shleifer 3487be75ef
[Marian] documentation and AutoModel support (#4152)
- MarianSentencepieceTokenizer - > MarianTokenizer
- Start using unk token.
- add docs page
- add better generation params to MarianConfig
- more conversion utilities
2020-05-10 13:54:57 -04:00
..
fixtures BIG Reorganize examples (#4213) 2020-05-07 13:48:44 -04:00
__init__.py GPU text generation: mMoved the encoded_prompt to correct device 2020-01-06 15:11:12 +01:00
test_activations.py Reformer (#3351) 2020-05-07 10:17:01 +02:00
test_configuration_auto.py Map configs to models and tokenizers 2020-01-13 23:11:44 +00:00
test_configuration_common.py Pass kwargs to configuration (#3147) 2020-03-05 17:16:57 -05:00
test_doc_samples.py make style 2020-03-04 20:18:07 -05:00
test_hf_api.py [cli] {login, upload, s3} display more helpful error messages 2020-04-30 12:51:06 -04:00
test_hf_argparser.py Trainer (#3800) 2020-04-21 20:11:56 -04:00
test_model_card.py GPU text generation: mMoved the encoded_prompt to correct device 2020-01-06 15:11:12 +01:00
test_modeling_albert.py Add AlbertForPreTraining and TFAlbertForPreTraining models. (#4057) 2020-05-07 19:44:51 -04:00
test_modeling_auto.py Add missing token classification for XLM (#3277) 2020-03-26 10:22:13 -04:00
test_modeling_bart.py [testing] add timeout_decorator (#3543) 2020-05-01 09:05:47 -04:00
test_modeling_bert.py [EncoderDecoder Tests] Improve tests (#4046) 2020-05-04 02:18:36 +02:00
test_modeling_camembert.py Add camembert integration tests (#3375) 2020-03-24 10:18:37 +01:00
test_modeling_common.py Reformer (#3351) 2020-05-07 10:17:01 +02:00
test_modeling_ctrl.py [ci] Load pretrained models into the default (long-lived) cache 2020-04-30 22:30:15 -04:00
test_modeling_distilbert.py [ci] Load pretrained models into the default (long-lived) cache 2020-04-30 22:30:15 -04:00
test_modeling_electra.py [ci] Load pretrained models into the default (long-lived) cache 2020-04-30 22:30:15 -04:00
test_modeling_encoder_decoder.py [EncoderDecoder Tests] Improve tests (#4046) 2020-05-04 02:18:36 +02:00
test_modeling_flaubert.py [ci] Load pretrained models into the default (long-lived) cache 2020-04-30 22:30:15 -04:00
test_modeling_gpt2.py [ci] Load pretrained models into the default (long-lived) cache 2020-04-30 22:30:15 -04:00
test_modeling_marian.py [Marian] documentation and AutoModel support (#4152) 2020-05-10 13:54:57 -04:00
test_modeling_openai.py [ci] Load pretrained models into the default (long-lived) cache 2020-04-30 22:30:15 -04:00
test_modeling_reformer.py Reformer (#3351) 2020-05-07 10:17:01 +02:00
test_modeling_roberta.py [ci] Load pretrained models into the default (long-lived) cache 2020-04-30 22:30:15 -04:00
test_modeling_t5.py [ci] Load pretrained models into the default (long-lived) cache 2020-04-30 22:30:15 -04:00
test_modeling_tf_albert.py Add AlbertForPreTraining and TFAlbertForPreTraining models. (#4057) 2020-05-07 19:44:51 -04:00
test_modeling_tf_auto.py Add AutoModelForPreTraining 2020-01-27 14:27:07 -05:00
test_modeling_tf_bert.py [ci] Load pretrained models into the default (long-lived) cache 2020-04-30 22:30:15 -04:00
test_modeling_tf_camembert.py Add camembert integration tests (#3375) 2020-03-24 10:18:37 +01:00
test_modeling_tf_common.py [Config, Caching] Remove output_past everywhere and replace by use_cache argument (#3734) 2020-04-14 14:40:28 -04:00
test_modeling_tf_ctrl.py [ci] Load pretrained models into the default (long-lived) cache 2020-04-30 22:30:15 -04:00
test_modeling_tf_distilbert.py [ci] Load pretrained models into the default (long-lived) cache 2020-04-30 22:30:15 -04:00
test_modeling_tf_electra.py [ci] Load pretrained models into the default (long-lived) cache 2020-04-30 22:30:15 -04:00
test_modeling_tf_gpt2.py [ci] Load pretrained models into the default (long-lived) cache 2020-04-30 22:30:15 -04:00
test_modeling_tf_openai_gpt.py [ci] Load pretrained models into the default (long-lived) cache 2020-04-30 22:30:15 -04:00
test_modeling_tf_roberta.py [ci] Load pretrained models into the default (long-lived) cache 2020-04-30 22:30:15 -04:00
test_modeling_tf_t5.py [ci] Load pretrained models into the default (long-lived) cache 2020-04-30 22:30:15 -04:00
test_modeling_tf_transfo_xl.py [ci] Load pretrained models into the default (long-lived) cache 2020-04-30 22:30:15 -04:00
test_modeling_tf_xlm.py [ci] Load pretrained models into the default (long-lived) cache 2020-04-30 22:30:15 -04:00
test_modeling_tf_xlnet.py [ci] Load pretrained models into the default (long-lived) cache 2020-04-30 22:30:15 -04:00
test_modeling_transfo_xl.py [ci] Load pretrained models into the default (long-lived) cache 2020-04-30 22:30:15 -04:00
test_modeling_xlm_roberta.py [ci] Re-run integration ground truth from fairseq 2020-03-03 15:31:40 -05:00
test_modeling_xlm.py [ci] Load pretrained models into the default (long-lived) cache 2020-04-30 22:30:15 -04:00
test_modeling_xlnet.py [ci] Load pretrained models into the default (long-lived) cache 2020-04-30 22:30:15 -04:00
test_optimization_tf.py TF version of the trainer (#4017) 2020-05-06 12:56:52 -04:00
test_optimization.py GPU text generation: mMoved the encoded_prompt to correct device 2020-01-06 15:11:12 +01:00
test_pipelines.py [Pipeline, Generation] tf generation pipeline bug (#4217) 2020-05-08 08:30:05 -04:00
test_tokenization_albert.py 💄 super 2020-01-15 18:33:50 -05:00
test_tokenization_auto.py Test correct tokenizers after default switch (#3003) 2020-02-24 18:45:53 -05:00
test_tokenization_bert_japanese.py BertJapaneseTokenizer accept options for mecab (#3566) 2020-04-03 11:12:19 -04:00
test_tokenization_bert.py Tokenizers v3.0.0 (#3185) 2020-04-07 00:29:15 +02:00
test_tokenization_common.py [tests] Light cleanup of tempfile in tests/ 2020-04-30 22:30:15 -04:00
test_tokenization_ctrl.py 💄 super 2020-01-15 18:33:50 -05:00
test_tokenization_distilbert.py Updating the TensorFlow models to work as expected with tokenizers v3.0.0 (#3684) 2020-04-08 16:22:44 -04:00
test_tokenization_fast.py Cleanup fast tokenizers integration (#3706) 2020-04-18 13:43:57 +02:00
test_tokenization_gpt2.py Tokenizers v3.0.0 (#3185) 2020-04-07 00:29:15 +02:00
test_tokenization_openai.py 💄 super 2020-01-15 18:33:50 -05:00
test_tokenization_roberta.py Preserve spaces in GPT-2 tokenizers (#2778) 2020-02-13 13:29:43 -05:00
test_tokenization_t5.py 💄 super 2020-01-15 18:33:50 -05:00
test_tokenization_transfo_xl.py 💄 super 2020-01-15 18:33:50 -05:00
test_tokenization_utils.py GPU text generation: mMoved the encoded_prompt to correct device 2020-01-06 15:11:12 +01:00
test_tokenization_xlm_roberta.py XLM-R Tokenizer now passes common tests + Integration tests (#3198) 2020-03-18 09:52:49 -04:00
test_tokenization_xlm.py XLM tokenizer should encode with bos token (#3791) 2020-04-17 11:28:55 -04:00
test_tokenization_xlnet.py 💄 super 2020-01-15 18:33:50 -05:00
test_trainer.py BIG Reorganize examples (#4213) 2020-05-07 13:48:44 -04:00
utils.py [ci] Load pretrained models into the default (long-lived) cache 2020-04-30 22:30:15 -04:00