thomwolf
e9a103c17a
bidirectional conversion TF <=> PT - extended tests
2019-09-24 13:25:50 +02:00
thomwolf
a31e591d27
fix XLM tests
2019-09-23 15:54:10 +02:00
thomwolf
969d3ae95e
XLMWithLMHead fixed - standardize conversion
2019-09-11 15:47:33 +02:00
thomwolf
4356f791a2
XLM passing tests
2019-09-11 11:49:54 +02:00
thomwolf
1efb1f1660
split configuration and modeling files
2019-09-08 15:02:06 +03:00
thomwolf
e25cba78cf
WIP reodering arguments for torchscript and TF
2019-09-04 22:39:23 +02:00
Thomas Wolf
ff7368eb6b
Merge pull request #1077 from huggingface/pruning-save-and-load
...
Pruning changes so that deleted heads are kept on save/load
2019-09-01 09:42:15 +02:00
LysandreJik
6ae0bb5291
XLM 100 different URLs
2019-08-31 14:46:31 -04:00
LysandreJik
819b468f70
Fixed XLM model url
2019-08-31 14:40:51 -04:00
LysandreJik
b6992b7b47
Applied patch to OpenAI GPT, RoBERTa, TransfoL, XLM and XLNet
2019-08-31 00:33:50 -04:00
LysandreJik
0c8e823b03
Added patch to remaining models
2019-08-31 00:33:50 -04:00
LysandreJik
87747518e9
Blocks deletion from already deleted heads. Necessary integration test.
...
Now raises a warning when a head to be deleted already has been deleted. An integration test verifying the total pipeline (-> from config -> save model -> load model -> additional head pruning) has been added.
2019-08-31 00:33:50 -04:00
LysandreJik
fc1fbae45d
XLM can be pruned
2019-08-31 00:33:50 -04:00
Thomas Wolf
cd65c41a83
Merge branch 'master' into xlm-tokenization
2019-08-30 17:15:16 +02:00
thomwolf
3871b8a107
adding xlm 17 and 100 models and config on aws
2019-08-30 16:28:42 +02:00
VictorSanh
7f5d85347e
fix small typo
2019-08-28 02:44:51 +00:00
Shijie Wu
f1b018740c
Add use_lang_emb to config
2019-08-23 20:33:01 -04:00
thomwolf
6d0aa73981
fix #1034
2019-08-20 12:20:21 +02:00
thomwolf
53c8f700f4
fix #808
2019-08-20 11:29:26 +02:00
Lysandre
c589862b78
Doc: loading from config alone does not load the model weights
2019-08-19 10:17:47 -04:00
LysandreJik
f2b300df6b
fix #976
2019-08-08 10:38:57 -04:00
LysandreJik
7df303f5ad
fix #971
2019-08-08 10:36:26 -04:00
wangfei
6ec1ee9ec2
Fix examples in docstring
2019-08-06 11:32:54 +08:00
wangfei
beb03ec6c5
Fix examples of loading pretrained models in docstring
2019-08-06 11:24:46 +08:00
thomwolf
bfbe52ec39
cleaning up example docstrings
2019-07-27 20:25:39 +02:00
thomwolf
0227b4a940
fix #827
2019-07-23 14:06:43 +02:00
thomwolf
f289e6cfe4
fix docstrings
2019-07-16 15:31:21 +02:00
thomwolf
9726b229cf
model name typo
2019-07-16 15:17:45 +02:00
thomwolf
f7cd7392fd
fixed tests
2019-07-15 12:32:19 +02:00
thomwolf
44c985facd
update doc for XLM and XLNet
2019-07-15 11:36:50 +02:00
thomwolf
2918b7d2a0
updating tests
2019-07-12 10:57:58 +02:00
thomwolf
bd404735a7
embeddings resizing + tie_weights
2019-07-12 00:02:49 +02:00
LysandreJik
7fdbc47822
Added the two CLM XLM pretrained checkpoints.
...
Fixed file extensions for config/vocab/merges of XLM models.
2019-07-10 19:37:24 -04:00
LysandreJik
dee3e45b93
Fixed XLM weights conversion script. Added 5 new checkpoints for XLM.
2019-07-10 19:04:21 -04:00
LysandreJik
8fe2c9d98e
Refactored Docstrings of BERT, GPT2, GPT, TransfoXL, XLM and XLNet.
2019-07-09 15:55:31 -04:00
thomwolf
d5481cbe1b
adding tests to examples - updating summary module - coverage update
2019-07-09 15:29:42 +02:00
thomwolf
b19786985d
unified tokenizer api and serialization + tests
2019-07-09 10:25:18 +02:00
thomwolf
36bca545ff
tokenization abstract class - tests for examples
2019-07-05 15:02:59 +02:00
thomwolf
0bab55d5d5
[BIG] name change
2019-07-05 11:55:36 +02:00