riaz.somc/transformers
1
0
Fork 0
mirror of https://github.com/huggingface/transformers.git synced 2025-07-31 10:12:23 +06:00
Code Issues Actions 23 Packages Projects Releases Wiki Activity
5,522 Commits 887 Branches 232 Tags 2.1 GiB
d8ca57d2ce
Commit Graph

5522 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Patrick von Platen
e3990d137a
fix (#6946) 2020-09-04 16:08:54 +02:00
Yih-Dar
a75e319819
Fix mixed precision issue in TF DistilBert (#6915) 
* Remove hard-coded uses of float32 to fix mixed precision use in TF Distilbert

* fix style

* fix gelu dtype issue in TF Distilbert

* fix numeric overflow while using half precision
 2020-09-04 14:29:57 +02:00
Sam Shleifer
e95d262f25
[s2s] support early stopping based on loss, rather than rouge (#6927) 2020-09-03 17:31:35 -04:00
Sam Shleifer
207ed8cb78
[s2s] use --eval_beams command line arg (#6926) 2020-09-03 12:42:09 -04:00
krfricke
0f360d3d1c
move wandb/comet logger init to train() to allow parallel logging (#6850) 
* move wandb/comet logger init to train() to allow parallel logging

* Setup wandb/comet loggers on first call to log()
 2020-09-03 11:49:14 -04:00
Sam Shleifer
39ed68d597
[s2s] allow task_specific_params=summarization_xsum (#6923) 2020-09-03 11:11:40 -04:00
Sam Shleifer
5a318f075a
[s2s]: script to convert pl checkpoints to hf checkpoints (#6911) 
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
 2020-09-03 09:47:00 -04:00
brett koonce
b8e4906c97
tweak tar command in readme (#6919) 2020-09-03 09:29:01 -04:00
Stefan Engl
a66db7d828
Corrected link to paper (#6905) 2020-09-03 09:23:42 -04:00
David Mark Nemeskey
55d61ce8d6
Added a link to the thesis. (#6906) 2020-09-03 09:20:03 -04:00
abdullaholuk-loodos
653a79ccad
Loodos model cards had errors on "Usage" section. It is fixed. Also "electra-base-turkish-uncased" model removed from s3 and re-uploaded as "electra-base-turkish-uncased-discriminator". Its README added. (#6921) 
Co-authored-by: Abdullah Oluk <abdullaholuk123@gmail.com>
 2020-09-03 09:13:43 -04:00
Julien Chaumond
5a3aec90a9
[model_card] link to correctly cased piaf dataset 
cc @psorianom @rachelker
 2020-09-03 08:57:32 -04:00
Sylvain Gugger
722b5807d8
Template updates (#6914) 2020-09-03 04:14:58 -04:00
Antonio V Mendoza
ea2c6f1afc
Adding the LXMERT pretraining model (MultiModal languageXvision) to HuggingFace's suite of models (#5793) 
* added template files for LXMERT and competed the configuration_lxmert.py

* added modeling, tokization, testing, and finishing touched for lxmert [yet to be tested]

* added model card for lxmert

* cleaning up lxmert code

* Update src/transformers/modeling_lxmert.py

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>

* Update src/transformers/modeling_tf_lxmert.py

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>

* Update src/transformers/modeling_tf_lxmert.py

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>

* Update src/transformers/modeling_lxmert.py

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>

* tested torch lxmert, changed documtention, updated outputs, and other small fixes

* Update src/transformers/convert_pytorch_checkpoint_to_tf2.py

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>

* Update src/transformers/convert_pytorch_checkpoint_to_tf2.py

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>

* Update src/transformers/convert_pytorch_checkpoint_to_tf2.py

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>

* renaming, other small issues, did not change TF code in this commit

* added lxmert question answering model in pytorch

* added capability to edit number of qa labels for lxmert

* made answer optional for lxmert question answering

* add option to return hidden_states for lxmert

* changed default qa labels for lxmert

* changed config archive path

* squshing 3 commits: merged UI + testing improvments + more UI and testing

* changed some variable names for lxmert

* TF LXMERT

* Various fixes to LXMERT

* Final touches to LXMERT

* AutoTokenizer order

* Add LXMERT to index.rst and README.md

* Merge commit test fixes + Style update

* TensorFlow 2.3.0 sequential model changes variable names

Remove inherited test

* Update src/transformers/modeling_tf_pytorch_utils.py

* Update docs/source/model_doc/lxmert.rst

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* Update docs/source/model_doc/lxmert.rst

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* Update src/transformers/modeling_tf_lxmert.py

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* added suggestions

* Fixes

* Final fixes for TF model

* Fix docs

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>
Co-authored-by: Lysandre <lysandre.debut@reseau.eseo.fr>
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
 2020-09-03 04:02:25 -04:00
Puneetha Pai
4ebb52afdb
test_tf_common: remove un_used mixin class parameters (#6866) 2020-09-02 10:54:40 -04:00
Stas Bekman
e71f32c0ef
[testing] fix ambiguous test (#6898) 
Since `generate()` does:
```
        num_beams = num_beams if num_beams is not None else self.config.num_beams
```
This test fails if `model.config.num_beams > 1` (which is the case in the model I'm porting).

This fix makes the test setup unambiguous by passing an explicit `num_beams=1` to `generate()`.

Thanks.
 2020-09-02 16:18:17 +02:00
Sylvain Gugger
8f2723caf0
Output attention takes an s (#6903) 
* Fix output_attention -> output_attentions

* Formatting

* One unsaved file
 2020-09-02 08:11:45 -04:00
Yohei Tamura
485da7222f
fix error class instantiation (#6634) 2020-09-02 07:36:32 -04:00
Suraj Patil
4230d30f77
[pipelines] Text2TextGenerationPipeline (#6744) 
* add Text2TextGenerationPipeline

* remove max length warning

* remove comments

* remove input_length

* fix typo

* add tests

* use TFAutoModelForSeq2SeqLM

* doc

* typo

* add the doc below TextGenerationPipeline

* doc nit

* style

* delete comment
 2020-09-02 07:34:35 -04:00
Prajjwal Bhargava
6b24281229
fix typo in comments (#6838) 2020-09-02 06:55:37 -04:00
Stas Bekman
7351ef83c1
[doc] typos (#6867) 
* [doc] typos

fixed typos

* Update README.md
 2020-09-02 06:51:51 -04:00
Harry Wang
ee1bff06f8
minor docs grammar fixes (#6889) 2020-09-02 06:45:19 -04:00
Patrick von Platen
8abd7f69fc
fix warning for position ids (#6884) 2020-09-02 06:44:51 -04:00
Parthe Pandit
7cb0572c64
Update modeling_bert.py (#6897) 
outptus -> outputs in example of BertForPreTraining
 2020-09-02 06:39:01 -04:00
David Mark Nemeskey
e3c55ceb8d
Model card for huBERT (#6893) 
* Create README.md

Model card for huBERT.

* Update README.md

lowercase h

* Update model_cards/SZTAKI-HLT/hubert-base-cc/README.md

Co-authored-by: Julien Chaumond <chaumond@gmail.com>
 2020-09-02 04:50:10 -04:00
Patrick von Platen
1889e96c8c
fix QA example for PT (#6890) 2020-09-02 09:53:09 +02:00
Julien Chaumond
d822ab636b [model_cards] Fix file path for flexudy/t5-base-multi-sentence-doctor 2020-09-02 00:02:40 +02:00
Rohan Rajpal
ad5fb33c9a
Create README.md (#6598) 2020-09-01 17:59:15 -04:00
Rohan Rajpal
f9dadcd85b
Create README.md (#6602) 2020-09-01 17:58:43 -04:00
Igli Manaj
f5d69c75f7
Update multilingual passage rereanking model card (#6788) 
Fix range of possible score, add inference .
 2020-09-01 17:56:19 -04:00
Tom Grek
5d820f3ca6
Model card for primer/BART-Squad2 (#6801) 2020-09-01 17:52:32 -04:00
zolekode
8b884dadc6
added model card for flexudys t5 model (#6759) 
Co-authored-by: zolekode <pascal.zoleko@fau.de>
 2020-09-01 17:38:55 -04:00
hakan
bff6d517cd
loodos turkish model cards added (#6840) 2020-09-01 17:35:24 -04:00
Manuel Romero
502d194b95
Create README.md (#6887) 
Add language meta attribute
 2020-09-01 17:09:10 -04:00
Manuel Romero
d082edf216
Create README.md (#6888) 
Add language meta attribute
 2020-09-01 17:09:02 -04:00
Abed khooli
dacbee9a50
Create README.md (#6886) 
* Create README.md

model card for  akhooli/xlm-r-large-arabic-sent

* Update model_cards/akhooli/xlm-r-large-arabic-sent/README.md

Co-authored-by: Julien Chaumond <chaumond@gmail.com>
 2020-09-01 17:06:15 -04:00
Abed khooli
e2971e61bd
Create README.md (#6885) 2020-09-01 16:57:48 -04:00
Patrick von Platen
4d1a3ffde8
[EncoderDecoder] Add xlm-roberta to encoder decoder (#6878) 
* finish xlm-roberta

* finish docs

* expose XLMRobertaForCausalLM
 2020-09-01 21:56:39 +02:00
Patrick von Platen
311992630c
Create README.md (#6883) 
* Create README.md

* Update README.md
 2020-09-01 19:24:45 +02:00
Jin Young (Daniel) Sohn
21d719238c
Add cache_dir to save features TextDataset (#6879) 
* Add cache_dir to save features TextDataset

This is in case the dataset is in a RO filesystem, for which is the case
in tests (GKE TPU tests).

* style
 2020-09-01 11:42:17 -04:00
Lysandre Debut
1461aac8d7
Update docs stable version 2020-09-01 11:02:24 -04:00
Lysandre
3726754a6c v3.1.0 documentation 2020-09-01 14:39:07 +02:00
Lysandre
4b3ee9cbc5 Release: v3.1.0 2020-09-01 14:27:52 +02:00
Patrick von Platen
afc4ece462
[Generate] Facilitate PyTorch generate using ModelOutputs (#6735) 
* fix generate for GPT2 Double Head

* fix gpt2 double head model

* fix  bart / t5

* also add for no beam search

* fix no beam search

* fix encoder decoder

* simplify t5

* simplify t5

* fix t5 tests

* fix BART

* fix transfo-xl

* fix conflict

* integrating sylvains and sams comments

* fix tf past_decoder_key_values

* fix enc dec test
 2020-09-01 12:38:25 +02:00
Funtowicz Morgan
397f819615
Restore PaddingStrategy.MAX_LENGTH on QAPipeline while no v2. (#6875) 
Signed-off-by: Morgan Funtowicz <funtowiczmo@gmail.com>
 2020-09-01 05:35:35 -04:00
Sam Shleifer
a32d85f0d4
delete reinit (#6862) 2020-09-01 03:43:27 -04:00
Sylvain Gugger
d5f1ffa0d8
Logging doc (#6852) 
* Add logging doc

* Foamtting

* Update docs/source/main_classes/logging.rst

* Update src/transformers/utils/logging.py

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>
 2020-09-01 03:16:34 -04:00
Stas Bekman
59a6a32a61
add a final report to all pytest jobs (#6861) 
we had it added for one job, please add it to all pytest jobs - we need the output of what tests were run to debug the codecov issue. thank you!
 2020-08-31 22:47:23 -04:00
Sam Shleifer
431ab19d7a
[fix] typo in available in helper function (#6859) 2020-08-31 17:59:34 -04:00
Sam Shleifer
367235ee52
Bart can make decoder_input_ids from labels (#6758) 2020-08-31 16:16:47 -04:00