Sam Shleifer
a4fc0c80b1
[s2s] run_eval.py parses generate_kwargs ( #6948 )
2020-09-04 14:19:31 -04:00
Sam Shleifer
6078b12098
[s2s] distill: --normalize_hidden --supervise_forward ( #6834 )
2020-09-04 14:05:56 -04:00
Stas Bekman
c5d43a872f
[docstring] misc arg doc corrections ( #6932 )
...
* correct bool types
fix docstring s/int/bool/
* fix description
* fix num_labels to match reality
2020-09-04 10:09:42 -04:00
Patrick von Platen
e3990d137a
fix ( #6946 )
2020-09-04 16:08:54 +02:00
Yih-Dar
a75e319819
Fix mixed precision issue in TF DistilBert ( #6915 )
...
* Remove hard-coded uses of float32 to fix mixed precision use in TF Distilbert
* fix style
* fix gelu dtype issue in TF Distilbert
* fix numeric overflow while using half precision
2020-09-04 14:29:57 +02:00
Sam Shleifer
e95d262f25
[s2s] support early stopping based on loss, rather than rouge ( #6927 )
2020-09-03 17:31:35 -04:00
Sam Shleifer
207ed8cb78
[s2s] use --eval_beams command line arg ( #6926 )
2020-09-03 12:42:09 -04:00
krfricke
0f360d3d1c
move wandb/comet logger init to train() to allow parallel logging ( #6850 )
...
* move wandb/comet logger init to train() to allow parallel logging
* Setup wandb/comet loggers on first call to log()
2020-09-03 11:49:14 -04:00
Sam Shleifer
39ed68d597
[s2s] allow task_specific_params=summarization_xsum ( #6923 )
2020-09-03 11:11:40 -04:00
Sam Shleifer
5a318f075a
[s2s]: script to convert pl checkpoints to hf checkpoints ( #6911 )
...
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
2020-09-03 09:47:00 -04:00
brett koonce
b8e4906c97
tweak tar command in readme ( #6919 )
2020-09-03 09:29:01 -04:00
Stefan Engl
a66db7d828
Corrected link to paper ( #6905 )
2020-09-03 09:23:42 -04:00
David Mark Nemeskey
55d61ce8d6
Added a link to the thesis. ( #6906 )
2020-09-03 09:20:03 -04:00
abdullaholuk-loodos
653a79ccad
Loodos model cards had errors on "Usage" section. It is fixed. Also "electra-base-turkish-uncased" model removed from s3 and re-uploaded as "electra-base-turkish-uncased-discriminator". Its README added. ( #6921 )
...
Co-authored-by: Abdullah Oluk <abdullaholuk123@gmail.com>
2020-09-03 09:13:43 -04:00
Julien Chaumond
5a3aec90a9
[model_card] link to correctly cased piaf dataset
...
cc @psorianom @rachelker
2020-09-03 08:57:32 -04:00
Sylvain Gugger
722b5807d8
Template updates ( #6914 )
2020-09-03 04:14:58 -04:00
Antonio V Mendoza
ea2c6f1afc
Adding the LXMERT pretraining model (MultiModal languageXvision) to HuggingFace's suite of models ( #5793 )
...
* added template files for LXMERT and competed the configuration_lxmert.py
* added modeling, tokization, testing, and finishing touched for lxmert [yet to be tested]
* added model card for lxmert
* cleaning up lxmert code
* Update src/transformers/modeling_lxmert.py
Co-authored-by: Lysandre Debut <lysandre@huggingface.co>
* Update src/transformers/modeling_tf_lxmert.py
Co-authored-by: Lysandre Debut <lysandre@huggingface.co>
* Update src/transformers/modeling_tf_lxmert.py
Co-authored-by: Lysandre Debut <lysandre@huggingface.co>
* Update src/transformers/modeling_lxmert.py
Co-authored-by: Lysandre Debut <lysandre@huggingface.co>
* tested torch lxmert, changed documtention, updated outputs, and other small fixes
* Update src/transformers/convert_pytorch_checkpoint_to_tf2.py
Co-authored-by: Lysandre Debut <lysandre@huggingface.co>
* Update src/transformers/convert_pytorch_checkpoint_to_tf2.py
Co-authored-by: Lysandre Debut <lysandre@huggingface.co>
* Update src/transformers/convert_pytorch_checkpoint_to_tf2.py
Co-authored-by: Lysandre Debut <lysandre@huggingface.co>
* renaming, other small issues, did not change TF code in this commit
* added lxmert question answering model in pytorch
* added capability to edit number of qa labels for lxmert
* made answer optional for lxmert question answering
* add option to return hidden_states for lxmert
* changed default qa labels for lxmert
* changed config archive path
* squshing 3 commits: merged UI + testing improvments + more UI and testing
* changed some variable names for lxmert
* TF LXMERT
* Various fixes to LXMERT
* Final touches to LXMERT
* AutoTokenizer order
* Add LXMERT to index.rst and README.md
* Merge commit test fixes + Style update
* TensorFlow 2.3.0 sequential model changes variable names
Remove inherited test
* Update src/transformers/modeling_tf_pytorch_utils.py
* Update docs/source/model_doc/lxmert.rst
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
* Update docs/source/model_doc/lxmert.rst
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
* Update src/transformers/modeling_tf_lxmert.py
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
* added suggestions
* Fixes
* Final fixes for TF model
* Fix docs
Co-authored-by: Lysandre Debut <lysandre@huggingface.co>
Co-authored-by: Lysandre <lysandre.debut@reseau.eseo.fr>
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
2020-09-03 04:02:25 -04:00
Puneetha Pai
4ebb52afdb
test_tf_common: remove un_used mixin class parameters ( #6866 )
2020-09-02 10:54:40 -04:00
Stas Bekman
e71f32c0ef
[testing] fix ambiguous test ( #6898 )
...
Since `generate()` does:
```
num_beams = num_beams if num_beams is not None else self.config.num_beams
```
This test fails if `model.config.num_beams > 1` (which is the case in the model I'm porting).
This fix makes the test setup unambiguous by passing an explicit `num_beams=1` to `generate()`.
Thanks.
2020-09-02 16:18:17 +02:00
Sylvain Gugger
8f2723caf0
Output attention takes an s ( #6903 )
...
* Fix output_attention -> output_attentions
* Formatting
* One unsaved file
2020-09-02 08:11:45 -04:00
Yohei Tamura
485da7222f
fix error class instantiation ( #6634 )
2020-09-02 07:36:32 -04:00
Suraj Patil
4230d30f77
[pipelines] Text2TextGenerationPipeline ( #6744 )
...
* add Text2TextGenerationPipeline
* remove max length warning
* remove comments
* remove input_length
* fix typo
* add tests
* use TFAutoModelForSeq2SeqLM
* doc
* typo
* add the doc below TextGenerationPipeline
* doc nit
* style
* delete comment
2020-09-02 07:34:35 -04:00
Prajjwal Bhargava
6b24281229
fix typo in comments ( #6838 )
2020-09-02 06:55:37 -04:00
Stas Bekman
7351ef83c1
[doc] typos ( #6867 )
...
* [doc] typos
fixed typos
* Update README.md
2020-09-02 06:51:51 -04:00
Harry Wang
ee1bff06f8
minor docs grammar fixes ( #6889 )
2020-09-02 06:45:19 -04:00
Patrick von Platen
8abd7f69fc
fix warning for position ids ( #6884 )
2020-09-02 06:44:51 -04:00
Parthe Pandit
7cb0572c64
Update modeling_bert.py ( #6897 )
...
outptus -> outputs in example of BertForPreTraining
2020-09-02 06:39:01 -04:00
David Mark Nemeskey
e3c55ceb8d
Model card for huBERT ( #6893 )
...
* Create README.md
Model card for huBERT.
* Update README.md
lowercase h
* Update model_cards/SZTAKI-HLT/hubert-base-cc/README.md
Co-authored-by: Julien Chaumond <chaumond@gmail.com>
2020-09-02 04:50:10 -04:00
Patrick von Platen
1889e96c8c
fix QA example for PT ( #6890 )
2020-09-02 09:53:09 +02:00
Julien Chaumond
d822ab636b
[model_cards] Fix file path for flexudy/t5-base-multi-sentence-doctor
2020-09-02 00:02:40 +02:00
Rohan Rajpal
ad5fb33c9a
Create README.md ( #6598 )
2020-09-01 17:59:15 -04:00
Rohan Rajpal
f9dadcd85b
Create README.md ( #6602 )
2020-09-01 17:58:43 -04:00
Igli Manaj
f5d69c75f7
Update multilingual passage rereanking model card ( #6788 )
...
Fix range of possible score, add inference .
2020-09-01 17:56:19 -04:00
Tom Grek
5d820f3ca6
Model card for primer/BART-Squad2 ( #6801 )
2020-09-01 17:52:32 -04:00
zolekode
8b884dadc6
added model card for flexudys t5 model ( #6759 )
...
Co-authored-by: zolekode <pascal.zoleko@fau.de>
2020-09-01 17:38:55 -04:00
hakan
bff6d517cd
loodos turkish model cards added ( #6840 )
2020-09-01 17:35:24 -04:00
Manuel Romero
502d194b95
Create README.md ( #6887 )
...
Add language meta attribute
2020-09-01 17:09:10 -04:00
Manuel Romero
d082edf216
Create README.md ( #6888 )
...
Add language meta attribute
2020-09-01 17:09:02 -04:00
Abed khooli
dacbee9a50
Create README.md ( #6886 )
...
* Create README.md
model card for akhooli/xlm-r-large-arabic-sent
* Update model_cards/akhooli/xlm-r-large-arabic-sent/README.md
Co-authored-by: Julien Chaumond <chaumond@gmail.com>
2020-09-01 17:06:15 -04:00
Abed khooli
e2971e61bd
Create README.md ( #6885 )
2020-09-01 16:57:48 -04:00
Patrick von Platen
4d1a3ffde8
[EncoderDecoder] Add xlm-roberta to encoder decoder ( #6878 )
...
* finish xlm-roberta
* finish docs
* expose XLMRobertaForCausalLM
2020-09-01 21:56:39 +02:00
Patrick von Platen
311992630c
Create README.md ( #6883 )
...
* Create README.md
* Update README.md
2020-09-01 19:24:45 +02:00
Jin Young (Daniel) Sohn
21d719238c
Add cache_dir to save features TextDataset ( #6879 )
...
* Add cache_dir to save features TextDataset
This is in case the dataset is in a RO filesystem, for which is the case
in tests (GKE TPU tests).
* style
2020-09-01 11:42:17 -04:00
Lysandre Debut
1461aac8d7
Update docs stable version
2020-09-01 11:02:24 -04:00
Lysandre
3726754a6c
v3.1.0 documentation
2020-09-01 14:39:07 +02:00
Lysandre
4b3ee9cbc5
Release: v3.1.0
2020-09-01 14:27:52 +02:00
Patrick von Platen
afc4ece462
[Generate] Facilitate PyTorch generate using ModelOutputs ( #6735 )
...
* fix generate for GPT2 Double Head
* fix gpt2 double head model
* fix bart / t5
* also add for no beam search
* fix no beam search
* fix encoder decoder
* simplify t5
* simplify t5
* fix t5 tests
* fix BART
* fix transfo-xl
* fix conflict
* integrating sylvains and sams comments
* fix tf past_decoder_key_values
* fix enc dec test
2020-09-01 12:38:25 +02:00
Funtowicz Morgan
397f819615
Restore PaddingStrategy.MAX_LENGTH on QAPipeline while no v2. ( #6875 )
...
Signed-off-by: Morgan Funtowicz <funtowiczmo@gmail.com>
2020-09-01 05:35:35 -04:00
Sam Shleifer
a32d85f0d4
delete reinit ( #6862 )
2020-09-01 03:43:27 -04:00
Sylvain Gugger
d5f1ffa0d8
Logging doc ( #6852 )
...
* Add logging doc
* Foamtting
* Update docs/source/main_classes/logging.rst
* Update src/transformers/utils/logging.py
Co-authored-by: Lysandre Debut <lysandre@huggingface.co>
2020-09-01 03:16:34 -04:00
