Patrick von Platen
aceb3fbaf4
only do output_past=True for language generation in bart
2020-03-11 11:06:56 +01:00
Patrick von Platen
7cba11fb9b
better naming
2020-03-11 11:06:56 +01:00
Patrick von Platen
ff648221bd
fix conflicts
2020-03-11 11:06:56 +01:00
Patrick von Platen
c0d9dd3ba9
refactored code a bit and made more generic
2020-03-11 11:06:56 +01:00
Patrick von Platen
d8e2b3c547
fix conflicts
2020-03-11 11:06:56 +01:00
Julien Chaumond
d6de6423ba
[doc] --organization tweak
...
Co-Authored-By: Thomas Wolf <thomwolf@users.noreply.github.com>
2020-03-10 16:52:44 -04:00
Julien Chaumond
0e56dc3078
[doc] Document the new --organization flag of CLI
2020-03-10 16:42:01 -04:00
Julien Chaumond
270dfa1c8e
[dialogpt] conversion script
...
Reference: https://github.com/huggingface/transformers/pull/1778#issuecomment-567675530
cc @patrickvonplaten and @dreasysnail
2020-03-10 15:09:29 -04:00
Manuel Romero
2661d80687
Update README.md
...
- Clarify that the model is not trained on the evaluation dataset
2020-03-10 10:59:34 -04:00
Manuel Romero
6a13448ad2
Update README.md
...
- Fix path of tokenizer
- Clarify that the model is not trained on the evaluation set
2020-03-10 10:59:16 -04:00
Manuel Romero
e57533cca5
Create README.md
2020-03-10 10:58:13 -04:00
Patrick von Platen
31f2437f07
Merge pull request #3191 from patrickvonplaten/add_integration_tests_lm_generate_torch_tf
...
Add integration tests lm generate torch tf
2020-03-10 11:29:17 +01:00
Shubham Agarwal
5ca356a464
NER - pl example ( #3180 )
...
* 1. seqeval required by ner pl example. install from examples/requirements. 2. unrecognized arguments: save_steps
* pl checkpoint callback filenotfound error: make directory and pass
* #3159 pl checkpoint path difference
* 1. Updated Readme for pl 2. pl script now also correct displays logs 3. pass gpu ids compared to number of gpus
* Updated results in readme
* 1. updated readme 2. removing deprecated pl methods 3. finalizing scripts
* comment length check
* using deprecated validation_end for stable results
* style related changes
2020-03-09 20:43:38 -04:00
Travis McGuire
f51ba059b9
Model card for albert-base-v2-squad2
2020-03-09 19:37:15 -04:00
Julien Chaumond
cbf8f5d32b
[model upload] Support for organizations
2020-03-09 17:33:57 -04:00
Lysandre
525b6b1c54
TFQA pipeline marked as slow test
2020-03-09 16:52:30 -04:00
Sam Shleifer
3aca02efb3
Bart example: model.to(device) ( #3194 )
2020-03-09 15:09:35 -04:00
Lysandre Debut
5164ea91a7
Skipping outputs ( #3116 )
...
* Minimal example
* Proposal 2
* Proposal 2 for fast tokenizers
* Typings
* Docs
* Revert "Docs" for easier review
This reverts commit eaf0f97062e809887704a542144c537f769d5223.
* Remove unnecessary assignments
* Tests
* Fix faulty type
* Remove prints
* return_outputs -> model_input_names
* Revert "Revert "Docs" for easier review"
This reverts commit 6fdc69408102bf695797f2dfddbb6350c6b9e722.
* code quality
2020-03-09 13:48:58 -04:00
Patrick von Platen
49debe62fd
Merge pull request #3190 from patrickvonplaten/fix_repetition_penalty_in_tf_generate
...
fix repetition penalty mask in tf
2020-03-09 16:29:57 +01:00
Patrick von Platen
847d370301
fix typo
2020-03-09 16:18:29 +01:00
Lysandre
eb3e6cb04f
cased -> uncased in BERT SQuAD example
...
closes #3183
2020-03-09 10:54:18 -04:00
Patrick von Platen
9050ffe035
delete w! -> need to be more careful with vim
2020-03-09 15:43:12 +01:00
Patrick von Platen
efb619235c
add print statement to avoid code quality problem
2020-03-09 15:31:21 +01:00
Patrick von Platen
b12541c4dc
test ctrl
2020-03-09 13:58:01 +00:00
Patrick von Platen
3e624c64ca
fix repetition penalty mask in tf
2020-03-09 14:55:11 +01:00
Patrick von Platen
b73dd1a0e4
fix typo in test xlm tf
2020-03-09 11:34:31 +01:00
Patrick von Platen
4620caa864
fix if use lang embeddings in tf xlm
2020-03-09 11:18:54 +01:00
patrickvonplaten
fbd02d4693
fixed all tests, still need to check ctrl tf and pt and xlm tf
2020-03-08 21:45:55 +01:00
patrickvonplaten
b4a3a64744
fix xlnet & transfotests
2020-03-08 16:25:03 +01:00
Param bhavsar
b29fed790b
Updated Tokenw ise
in print statement to Token wise
2020-03-08 10:55:30 -04:00
patrickvonplaten
66c827656f
fix typo in test gpt2
2020-03-08 15:35:08 +01:00
patrickvonplaten
314bdc7c14
fix typo in test
2020-03-08 15:34:20 +01:00
patrickvonplaten
575976144a
updated all tests
2020-03-08 15:29:10 +01:00
Julien Chaumond
e03129ad44
[model_cards] Small formatting fix
...
cc @mrm8488
2020-03-06 18:07:44 -05:00
Julien Chaumond
08a70fb392
[model_cards] Fixup d6df9a8f
2020-03-06 17:50:38 -05:00
Lysandre Debut
0ae91c80aa
Change back pipeline signatures ( #3105 )
...
* Change back pipeline signatures
* String types for non-imported objects
2020-03-06 17:26:18 -05:00
voidful
d6df9a8ffe
[model_cards]Add albert chinese model(tiny,small,base,large,xlarge,xxlarge)
2020-03-06 17:23:31 -05:00
Manuel Romero
c52716d46c
Create README.md
2020-03-06 17:20:19 -05:00
Aleksei Lymar
73a0c25376
remove excess line breaks in DeepPavlov model cards
2020-03-06 17:19:35 -05:00
Sam Shleifer
ed37f9fa4f
[Bart] _prepare_decoder_inputs should use large negative ( #3158 )
2020-03-06 16:06:36 -05:00
Thomas Wolf
0416d437fb
Merge pull request #3148 from patrickvonplaten/refactoring_beam_search_for_tf_2
...
refactored beam search according to torch implementation
2020-03-06 22:01:46 +01:00
Funtowicz Morgan
db9279dedb
Fix QA models binding for Flaubert, XLNet and XLM. ( #3100 )
...
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>
Format & quality
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>
Again.
Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>
2020-03-06 13:04:29 -05:00
Sam Shleifer
e58b3ec5df
add imports to examples ( #3160 )
2020-03-06 11:15:33 -05:00
Thomas Wolf
6ffe03a0a1
Merge pull request #3137 from tomhosking/bart-refactor
...
Refactor BartModel so that input checks are handled within enc/dec
2020-03-06 13:06:34 +01:00
Thomas Wolf
3e5da38dae
Merge pull request #3132 from huggingface/hf_api_model_list
...
[hf_api] Get the public list of all the models on huggingface
2020-03-06 13:05:52 +01:00
Thomas Wolf
9499a3778e
Merge pull request #3103 from gthb/keras-serialization
...
Support keras JSON/HDF5 serialization of main layers
2020-03-06 12:59:13 +01:00
patrickvonplaten
9362eb4a07
refactored beam search according to torch implementation
2020-03-06 00:46:29 +01:00
Patrick von Platen
c8035e11e8
Merge pull request #3149 from patrickvonplaten/fix_renaming_error
...
fix missed BartForMaskedLM renaming
2020-03-06 00:45:08 +01:00
patrickvonplaten
58fc8f97a3
fix renaming problem
2020-03-06 00:35:47 +01:00
Sam Shleifer
857e0a0d3b
Rename BartForMaskedLM -> BartForConditionalGeneration ( #3114 )
...
* improved documentation
2020-03-05 17:41:18 -05:00