Commit Graph

19383 Commits

Author SHA1 Message Date
thomwolf
4ddc31ff40 update readme with migration change 2019-09-26 12:00:38 +02:00
thomwolf
f47f7f4611 add logo 2019-09-26 11:28:44 +02:00
thomwolf
9fabc0b6a9 wip readme 2019-09-26 11:21:34 +02:00
thomwolf
31c23bd5ee [BIG] pytorch-transformers => transformers 2019-09-26 10:15:53 +02:00
thomwolf
2f071fcb02 clean up TFConv1D API 2019-09-26 10:09:45 +02:00
thomwolf
5705333441 add initialization for everybody 2019-09-26 10:06:20 +02:00
thomwolf
f2a337b3ed fix tokenization tests for gpt2 roberta 2019-09-26 09:02:43 +02:00
Thomas Wolf
4a233e5b2c
Merge pull request #1315 from bryant1410/patch-1
Remove unnecessary use of FusedLayerNorm
2019-09-26 08:50:02 +02:00
thomwolf
7a99e4b196 fix #1196 and fix #1285 2019-09-26 08:41:02 +02:00
thomwolf
7c9f8f93f9 fix tests 2019-09-26 01:59:53 +02:00
thomwolf
d6dde438ea add batch dimension in encode 2019-09-26 01:45:55 +02:00
thomwolf
4a21c4d88d add warning if neither pt nor tf are found 2019-09-26 01:30:06 +02:00
thomwolf
2967de06f4 adding intialization to bert 2019-09-25 22:08:38 +02:00
thomwolf
a6bcfb8015 fix tests 2019-09-25 21:14:12 +02:00
thomwolf
78863f6b36 fix tokenizer to tensors 2019-09-25 21:09:46 +02:00
thomwolf
8a618e0af5 clean up __init__ 2019-09-25 21:04:52 +02:00
thomwolf
3b7fb48c3b fix loading from tf/pt 2019-09-25 17:46:16 +02:00
thomwolf
a049c8043b push fix to training 2019-09-25 17:33:16 +02:00
mataney
a9f24a16bc [FIX] fix run_generation.py to work with batch_size > 1 2019-09-25 15:53:29 +03:00
thomwolf
5def3302f4 update run_glue 2019-09-25 12:38:08 +02:00
thomwolf
f71758f7a4 update internal glue processors 2019-09-25 12:00:50 +02:00
thomwolf
0f091062d4 Merge branch 'glue-example' into tf2 2019-09-25 10:21:52 +02:00
thomwolf
c4acc3a8e9 let encode accept tensor inputs 2019-09-25 10:19:14 +02:00
Thomas Wolf
e8e956dbb2
Merge pull request #1327 from huggingface/tf2-determinism
Pytorch/TF2 determinism
2019-09-24 22:49:57 +02:00
Thomas Wolf
e4022d96f7
Merge pull request #1325 from huggingface/glue-included
[Proposal] GLUE processors included in library
2019-09-24 21:40:10 +02:00
LysandreJik
1761d2091a Check to see if the models have the same results when in eval mode (pt) or when training=False (tf) 2019-09-24 14:59:10 -04:00
thomwolf
789ea72037 fix output_token_type in glue 2019-09-24 17:32:01 +02:00
thomwolf
1cbd566c63 Merge branch 'glue-example' into glue-included 2019-09-24 17:24:52 +02:00
thomwolf
743e383d4b py2 fix 2019-09-24 17:21:54 +02:00
thomwolf
99a90e43d4 update data processors __init__ 2019-09-24 17:16:46 +02:00
thomwolf
b5ec526f85 updated data processor and metrics 2019-09-24 17:10:50 +02:00
thomwolf
a6981076ec various updates 2019-09-24 16:46:26 +02:00
LysandreJik
0b82e3d0d9 Relative imports 2019-09-24 09:52:25 -04:00
LysandreJik
f09e5ecef0 [Proposal] GLUE processors included in library 2019-09-24 09:47:34 -04:00
thomwolf
128bdd4c35 fix tests pt/tf 2019-09-24 15:43:39 +02:00
LysandreJik
72402d1acd Fixed DistilBERT tokenizer 2019-09-24 09:41:14 -04:00
thomwolf
28a30af6d1 fix auto models 2019-09-24 15:33:39 +02:00
thomwolf
de203853cc docstring for xlnet 2019-09-24 15:30:55 +02:00
thomwolf
559790f9e4 docstring for xlm 2019-09-24 15:26:57 +02:00
thomwolf
b3087ddde8 docstring t-xl 2019-09-24 15:21:51 +02:00
thomwolf
4761a39781 doctring roberta 2019-09-24 15:19:09 +02:00
thomwolf
45a6f2edd9 docstring for GPT 2019-09-24 15:15:47 +02:00
thomwolf
e7ba5bc85b docstring for GPT2 2019-09-24 15:12:36 +02:00
LysandreJik
d340e2329e create_mask_from_sequences -> create_token_type_ids_from_sequences 2019-09-24 09:09:28 -04:00
thomwolf
b94f73bab7 distilbert docstring 2019-09-24 15:06:51 +02:00
thomwolf
9678c49419 docstrings for bert 2019-09-24 14:57:05 +02:00
thomwolf
f3d1511b5b fix imports 2019-09-24 14:42:09 +02:00
thomwolf
dd2d90f344 update automodels 2019-09-24 14:39:41 +02:00
thomwolf
ee261439a9 add save_pretrained 2019-09-24 14:30:28 +02:00
thomwolf
29bb3e4eb0 double loading ok 2019-09-24 14:23:46 +02:00