Commit Graph

15053 Commits

Author SHA1 Message Date
thomwolf
1b35d05d4b update conversion scripts and __main__ 2019-07-16 09:41:55 +02:00
thomwolf
352e3ff998 added migration guide to readme 2019-07-16 09:03:49 +02:00
thomwolf
8ad7e5b4f2 indeed 2019-07-16 00:29:15 +02:00
thomwolf
064d0a0b76 update readme 2019-07-16 00:21:33 +02:00
thomwolf
3b8b0e01bb update readme 2019-07-16 00:12:55 +02:00
thomwolf
76da9765b6 fix run_generation test 2019-07-15 17:52:35 +02:00
thomwolf
e691fc0963 update QA models tests + run_generation 2019-07-15 17:45:24 +02:00
thomwolf
15d8b1266c update tokenizer - update squad example for xlnet 2019-07-15 17:30:42 +02:00
thomwolf
3b469cb422 updating squad for compatibility with XLNet 2019-07-15 15:28:37 +02:00
thomwolf
8ca767f13c clean up optimization 2019-07-15 13:49:07 +02:00
thomwolf
74a24f0fe9 clean up file_utils 2019-07-15 13:49:01 +02:00
thomwolf
ab49fafc04 update tokenization docstrings for #328 2019-07-15 12:51:23 +02:00
thomwolf
a9ab15174c fix #328 2019-07-15 12:42:12 +02:00
thomwolf
f7cd7392fd fixed tests 2019-07-15 12:32:19 +02:00
thomwolf
e28d8bde0d doc on base classes 2019-07-15 12:08:06 +02:00
thomwolf
44c985facd update doc for XLM and XLNet 2019-07-15 11:36:50 +02:00
thomwolf
0201d86015 added doc for transformer-xl 2019-07-15 10:11:09 +02:00
thomwolf
4cb489457f added doc for openai GPT 2019-07-15 09:58:01 +02:00
thomwolf
62b8eb43c1 fix add_start_docstrings on python 2 (removed) 2019-07-15 09:49:02 +02:00
thomwolf
5bc3d0cc5b added gpt2 doc 2019-07-15 09:40:05 +02:00
thomwolf
183fedfed5 fix doc on python2 2019-07-15 09:00:09 +02:00
thomwolf
0e9825e252 small fix to run_glue 2019-07-14 23:43:28 +02:00
thomwolf
2397f958f9 updating examples and doc 2019-07-14 23:20:10 +02:00
thomwolf
c490f5ce87 added generation examples in tests 2019-07-13 15:26:58 +02:00
thomwolf
8bb02c27e2 Merge branch 'xlnet' of https://github.com/huggingface/pytorch-pretrained-BERT into xlnet 2019-07-13 15:25:06 +02:00
thomwolf
7d4b200e40 good quality generation example for GPT, GPT-2, Transfo-XL, XLNet 2019-07-13 15:25:03 +02:00
Thomas Wolf
69dc010936
Merge pull request #786 from huggingface/doc-sphinx
New documentation for pytorch-transformers
2019-07-13 12:08:57 +02:00
thomwolf
7322c314a6 remove python2 testing for examples 2019-07-12 14:24:08 +02:00
thomwolf
936e813c84 clean up examples - added squad example and test 2019-07-12 14:16:06 +02:00
thomwolf
699bc7e86e fix gpt-2 unk token test 2019-07-12 11:46:57 +02:00
thomwolf
762ded9b1c wip examples 2019-07-12 11:28:52 +02:00
thomwolf
7442956361 save config file 2019-07-12 11:26:16 +02:00
Thomas Wolf
292140b921
Merge pull request #781 from huggingface/embeddings
Clean up input embeddings resizing and weights tying
2019-07-12 11:10:25 +02:00
Thomas Wolf
c57e9d946f
Merge branch 'xlnet' into embeddings 2019-07-12 11:10:14 +02:00
thomwolf
2918b7d2a0 updating tests 2019-07-12 10:57:58 +02:00
LysandreJik
3fbceed8d2 Fix layer reference loss + previous attempted fix 2019-07-11 22:29:55 -04:00
LysandreJik
6c2ee16c04 Test suite testing the tie_weights function as well as the resize_token_embeddings function.
Patched an issue relating to the tied weights I had introduced with the TorchScript addition.
Byte order mark management in TSV glue reading.
2019-07-11 22:09:16 -04:00
LysandreJik
3821ecbf4a Byte order mark management in TSV glue reading. 2019-07-11 20:16:28 -04:00
LysandreJik
e3fb4310d6 From pretrained correct initialization. Unknown token handling for gpt2. 2019-07-11 18:44:29 -04:00
thomwolf
bd404735a7 embeddings resizing + tie_weights 2019-07-12 00:02:49 +02:00
LysandreJik
50e62a4cb4 fix gpt/gpt-2 from pretrained 2019-07-11 16:50:21 -04:00
thomwolf
273617b86d update config - fix gpt/gpt-2 from pretrained 2019-07-11 22:45:03 +02:00
thomwolf
6b13f4cb3a update circle-ci 2019-07-11 22:36:35 +02:00
thomwolf
2b644785f0 add tests on examples and large circle ci config 2019-07-11 22:31:50 +02:00
thomwolf
c6bf1a400d fix test examples et model pretrained 2019-07-11 22:29:08 +02:00
thomwolf
92a782b108 fix run_glue test 2019-07-11 22:20:10 +02:00
LysandreJik
6491575fd5 Added TorchScript disclaimer. CSS modifications. 2019-07-11 12:38:21 -04:00
thomwolf
ccb6947dc1 optimization tests 2019-07-11 17:39:47 +02:00
Thomas Wolf
e4f9dca018
Merge pull request #773 from huggingface/doc-sphinx
Sphinx doc, XLM Checkpoints
2019-07-11 15:46:39 +02:00
Thomas Wolf
b87eb82b4f
Merge branch 'xlnet' into doc-sphinx 2019-07-11 15:46:27 +02:00