riaz.somc/transformers
1
0
Fork 0
mirror of https://github.com/huggingface/transformers.git synced 2025-07-30 17:52:35 +06:00
Code Issues Actions 30 Packages Projects Releases Wiki Activity
00bb0b25ed
transformers/tests
History
Patrick von Platen 00bb0b25ed
TF Longformer (#5764) 
* improve names and tests longformer

* more and better tests for longformer

* add first tf test

* finalize tf basic op functions

* fix merge

* tf shape test passes

* narrow down discrepancies

* make longformer local attn tf work

* correct tf longformer

* add first global attn function

* add more global longformer func

* advance tf longformer

* finish global attn

* upload big model

* finish all tests

* correct false any statement

* fix common tests

* make all tests pass except keras save load

* fix some tests

* fix torch test import

* finish tests

* fix test

* fix torch tf tests

* add docs

* finish docs

* Update src/transformers/modeling_longformer.py

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>

* Update src/transformers/modeling_tf_longformer.py

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* apply Lysandres suggestions

* reverse to assert statement because function will fail otherwise

* applying sylvains recommendations

* Update src/transformers/modeling_longformer.py

Co-authored-by: Sam Shleifer <sshleifer@gmail.com>

* Update src/transformers/modeling_tf_longformer.py

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
Co-authored-by: Sam Shleifer <sshleifer@gmail.com>
2020-08-10 23:25:06 +02:00
..
fixtures BIG Reorganize examples (#4213) 2020-05-07 13:48:44 -04:00
__init__.py GPU text generation: mMoved the encoded_prompt to correct device 2020-01-06 15:11:12 +01:00
conftest.py enable easy checkout switch (#5645) 2020-07-31 04:34:46 -04:00
test_activations.py Move tests/utils.py -> transformers/testing_utils.py (#5350) 2020-07-01 10:31:17 -04:00
test_benchmark_tf.py [Benchmark] Add benchmarks for TF Training (#5594) 2020-07-08 12:11:09 +02:00
test_benchmark.py typos (#6162) 2020-07-30 17:18:27 -04:00
test_configuration_auto.py Move tests/utils.py -> transformers/testing_utils.py (#5350) 2020-07-01 10:31:17 -04:00
test_configuration_common.py Pass kwargs to configuration (#3147) 2020-03-05 17:16:57 -05:00
test_doc_samples.py Move tests/utils.py -> transformers/testing_utils.py (#5350) 2020-07-01 10:31:17 -04:00
test_hf_api.py [cli] {login, upload, s3} display more helpful error messages 2020-04-30 12:51:06 -04:00
test_hf_argparser.py parse arguments from dict (#4869) 2020-07-31 04:44:23 -04:00
test_model_card.py GPU text generation: mMoved the encoded_prompt to correct device 2020-01-06 15:11:12 +01:00
test_modeling_albert.py cleanup torch unittests (#6196) 2020-08-04 02:42:56 -04:00
test_modeling_auto.py [Fix] position_ids tests again (#6100) 2020-07-28 18:29:35 -04:00
test_modeling_bart.py Model output test (#6155) 2020-07-31 09:44:37 -04:00
test_modeling_bert.py [EncoderDecoderModel] add a add_cross_attention boolean to config (#6377) 2020-08-10 19:46:48 +02:00
test_modeling_camembert.py Model output test (#6155) 2020-07-31 09:44:37 -04:00
test_modeling_common.py Model output test (#6155) 2020-07-31 09:44:37 -04:00
test_modeling_ctrl.py cleanup torch unittests (#6196) 2020-08-04 02:42:56 -04:00
test_modeling_distilbert.py cleanup torch unittests (#6196) 2020-08-04 02:42:56 -04:00
test_modeling_dpr.py cleanup torch unittests (#6196) 2020-08-04 02:42:56 -04:00
test_modeling_electra.py Add a script to check all models are tested and documented (#6298) 2020-08-07 09:18:37 -04:00
test_modeling_encoder_decoder.py [EncoderDecoderModel] add a add_cross_attention boolean to config (#6377) 2020-08-10 19:46:48 +02:00
test_modeling_flaubert.py cleanup torch unittests (#6196) 2020-08-04 02:42:56 -04:00
test_modeling_gpt2.py cleanup torch unittests (#6196) 2020-08-04 02:42:56 -04:00
test_modeling_longformer.py TF Longformer (#5764) 2020-08-10 23:25:06 +02:00
test_modeling_marian.py Move tests/utils.py -> transformers/testing_utils.py (#5350) 2020-07-01 10:31:17 -04:00
test_modeling_mbart.py Model output test (#6155) 2020-07-31 09:44:37 -04:00
test_modeling_mobilebert.py cleanup torch unittests (#6196) 2020-08-04 02:42:56 -04:00
test_modeling_openai.py cleanup torch unittests (#6196) 2020-08-04 02:42:56 -04:00
test_modeling_reformer.py fix reformer fp16 (#6237) 2020-08-04 13:02:25 +02:00
test_modeling_roberta.py cleanup torch unittests (#6196) 2020-08-04 02:42:56 -04:00
test_modeling_t5.py cleanup torch unittests (#6196) 2020-08-04 02:42:56 -04:00
test_modeling_tf_albert.py Patch models (#6326) 2020-08-10 10:39:17 -04:00
test_modeling_tf_auto.py [Almost all TF models] TF clean up: add missing CLM / MLM loss; fix T5 naming and keras compile (#5395) 2020-07-07 18:15:53 +02:00
test_modeling_tf_bert.py Patch models (#6326) 2020-08-10 10:39:17 -04:00
test_modeling_tf_camembert.py Tf model outputs (#6247) 2020-08-05 11:34:39 -04:00
test_modeling_tf_common.py Tf model outputs (#6247) 2020-08-05 11:34:39 -04:00
test_modeling_tf_ctrl.py Tf model outputs (#6247) 2020-08-05 11:34:39 -04:00
test_modeling_tf_distilbert.py Tf model outputs (#6247) 2020-08-05 11:34:39 -04:00
test_modeling_tf_electra.py Patch models (#6326) 2020-08-10 10:39:17 -04:00
test_modeling_tf_flaubert.py Tf model outputs (#6247) 2020-08-05 11:34:39 -04:00
test_modeling_tf_gpt2.py Tf model outputs (#6247) 2020-08-05 11:34:39 -04:00
test_modeling_tf_longformer.py TF Longformer (#5764) 2020-08-10 23:25:06 +02:00
test_modeling_tf_mobilebert.py Tf model outputs (#6247) 2020-08-05 11:34:39 -04:00
test_modeling_tf_openai.py Add a script to check all models are tested and documented (#6298) 2020-08-07 09:18:37 -04:00
test_modeling_tf_roberta.py Tf model outputs (#6247) 2020-08-05 11:34:39 -04:00
test_modeling_tf_t5.py Tf model outputs (#6247) 2020-08-05 11:34:39 -04:00
test_modeling_tf_transfo_xl.py Tf model outputs (#6247) 2020-08-05 11:34:39 -04:00
test_modeling_tf_xlm_roberta.py Tf model outputs (#6247) 2020-08-05 11:34:39 -04:00
test_modeling_tf_xlm.py Tf model outputs (#6247) 2020-08-05 11:34:39 -04:00
test_modeling_tf_xlnet.py Tf model outputs (#6247) 2020-08-05 11:34:39 -04:00
test_modeling_transfo_xl.py Model output test (#6155) 2020-07-31 09:44:37 -04:00
test_modeling_xlm_roberta.py Model output test (#6155) 2020-07-31 09:44:37 -04:00
test_modeling_xlm.py cleanup torch unittests (#6196) 2020-08-04 02:42:56 -04:00
test_modeling_xlnet.py cleanup torch unittests (#6196) 2020-08-04 02:42:56 -04:00
test_onnx.py Added capability to quantize a model while exporting through ONNX. (#6089) 2020-07-29 13:21:29 +02:00
test_optimization_tf.py Move tests/utils.py -> transformers/testing_utils.py (#5350) 2020-07-01 10:31:17 -04:00
test_optimization.py refactor almost identical tests (#6339) 2020-08-10 05:31:20 -04:00
test_pipelines.py Addition of a DialoguePipeline (#5516) 2020-07-30 14:11:39 -04:00
test_tokenization_albert.py [HUGE] Refactoring tokenizers backend - padding - truncation - pre-tokenized pipeline - fast tokenizers - tests (#4510) 2020-06-15 17:12:51 -04:00
test_tokenization_auto.py Move tests/utils.py -> transformers/testing_utils.py (#5350) 2020-07-01 10:31:17 -04:00
test_tokenization_bert_japanese.py Move tests/utils.py -> transformers/testing_utils.py (#5350) 2020-07-01 10:31:17 -04:00
test_tokenization_bert.py Add strip_accents to basic BertTokenizer. (#6280) 2020-08-06 18:52:28 +08:00
test_tokenization_common.py Remove redundant coverage (#6224) 2020-08-04 02:59:21 -04:00
test_tokenization_ctrl.py [HUGE] Refactoring tokenizers backend - padding - truncation - pre-tokenized pipeline - fast tokenizers - tests (#4510) 2020-06-15 17:12:51 -04:00
test_tokenization_distilbert.py Move tests/utils.py -> transformers/testing_utils.py (#5350) 2020-07-01 10:31:17 -04:00
test_tokenization_dpr.py Fix tests imports dpr (#5576) 2020-07-07 16:35:12 +02:00
test_tokenization_fast.py Various tokenizers fixes (#5558) 2020-07-06 18:27:53 -04:00
test_tokenization_gpt2.py [HUGE] Refactoring tokenizers backend - padding - truncation - pre-tokenized pipeline - fast tokenizers - tests (#4510) 2020-06-15 17:12:51 -04:00
test_tokenization_marian.py [fix] Marian tests import (#5442) 2020-07-01 11:42:22 -04:00
test_tokenization_mbart.py Fix #6096: MBartTokenizer's mask token (#6098) 2020-07-28 18:27:58 -04:00
test_tokenization_openai.py [HUGE] Refactoring tokenizers backend - padding - truncation - pre-tokenized pipeline - fast tokenizers - tests (#4510) 2020-06-15 17:12:51 -04:00
test_tokenization_roberta.py Move tests/utils.py -> transformers/testing_utils.py (#5350) 2020-07-01 10:31:17 -04:00
test_tokenization_t5.py [cleanup] test_tokenization_common.py (#4390) 2020-05-19 10:46:55 -04:00
test_tokenization_transfo_xl.py Move tests/utils.py -> transformers/testing_utils.py (#5350) 2020-07-01 10:31:17 -04:00
test_tokenization_utils.py Move tests/utils.py -> transformers/testing_utils.py (#5350) 2020-07-01 10:31:17 -04:00
test_tokenization_xlm_roberta.py Move tests/utils.py -> transformers/testing_utils.py (#5350) 2020-07-01 10:31:17 -04:00
test_tokenization_xlm.py Move tests/utils.py -> transformers/testing_utils.py (#5350) 2020-07-01 10:31:17 -04:00
test_tokenization_xlnet.py Move tests/utils.py -> transformers/testing_utils.py (#5350) 2020-07-01 10:31:17 -04:00
test_trainer_distributed.py [Tokenization] Fix #5181 - make #5155 more explicit - move back the default logging level in tests to WARNING (#5252) 2020-06-25 17:24:28 +02:00
test_trainer.py Trainer support for iterabledataset (#5834) 2020-07-20 09:07:37 -04:00