Yiqing-Zhou
897d0841be
read().splitlines() -> readlines()
...
splitlines() does not work as what we expect here for bert-base-chinese because there is a '\u2028' (unicode line seperator) token in vocab file. Value of '\u2028'.splitlines() is ['', ''].
Perhaps we should use readlines() instead.
2019-07-22 20:49:09 +08:00
rish-16
2f869dc665
Fixed typo
2019-07-21 11:05:36 -04:00
Thomas Wolf
a615499076
Merge pull request #797 from yzy5630/fix-examples
...
fix some errors for distributed lm_finetuning
2019-07-18 23:32:33 +02:00
Thomas Wolf
dbecfcf321
Merge pull request #815 from praateekmahajan/update-readme-link
...
Update Readme link for Fine Tune/Usage section
2019-07-18 18:30:32 +02:00
Peiqin Lin
acc48a0cc9
typos
2019-07-18 09:54:04 -04:00
yzy5630
a1fe4ba9c9
use new API for save and load
2019-07-18 15:45:23 +08:00
Praateek Mahajan
0d46b17553
Update Readme
...
Incorrect link for `Quick tour: Fine-tuning/usage scripts`
2019-07-17 22:50:10 -07:00
yzy5630
a7ba27b1b4
add parser for adam
2019-07-18 08:52:51 +08:00
yzy5630
d6522e2873
change loss and optimizer to new API
2019-07-17 21:22:34 +08:00
thomwolf
71d597dad0
fix #800
2019-07-17 13:51:09 +02:00
Thomas Wolf
4bcddf6fc8
Merge pull request #801 from bzantium/master
...
import sys twice
2019-07-17 12:31:26 +02:00
Thomas Wolf
506ab34d0e
Merge pull request #796 from stefan-it/minor-doc-updates
...
Minor documentation updates
2019-07-17 12:26:34 +02:00
Minho Ryu
cd8980e1f4
import sys twice
2019-07-17 18:12:01 +09:00
yzy5630
123da5a2fa
fix errors for lm_finetuning examples
2019-07-17 09:56:07 +08:00
yzy5630
60a1bdcdac
fix some errors for distributed lm_finetuning
2019-07-17 09:16:20 +08:00
Stefan Schweter
e6cc6d237f
docs: fix link to various notebooks
2019-07-16 23:42:28 +02:00
Stefan Schweter
5b78400e21
docs: fix link to modeling example source (bert)
2019-07-16 23:41:57 +02:00
Stefan Schweter
61cc3ee350
docs: fix link to tf checkpoint to pytorch script
2019-07-16 23:41:04 +02:00
Stefan Schweter
dbbd94cb7a
docs: fix link to bertology example and update dataset description
2019-07-16 23:40:04 +02:00
thomwolf
5fe0b378d8
adding missing docstring fix #793
2019-07-16 21:35:53 +02:00
thomwolf
e848b54730
fix #792
2019-07-16 21:22:19 +02:00
thomwolf
c5b3d86a91
Merge branch 'master' of https://github.com/huggingface/pytorch-pretrained-BERT
2019-07-16 21:21:05 +02:00
thomwolf
6b70760204
typos
2019-07-16 21:21:03 +02:00
Thomas Wolf
b33a385091
update readme
2019-07-16 16:18:37 +02:00
thomwolf
ed7549bb1a
release version 1.0
2019-07-16 16:10:58 +02:00
thomwolf
6a72d9aa52
updated examples in readme
2019-07-16 16:09:29 +02:00
thomwolf
b59043bf8f
update readme
2019-07-16 16:03:48 +02:00
thomwolf
edc79acb3b
simpler quick tour
2019-07-16 16:02:32 +02:00
thomwolf
5c82d3488f
indicate default evaluation in breaking changes
2019-07-16 15:45:58 +02:00
thomwolf
4acaa65068
model in evaluation mode by default after from_pretrained
2019-07-16 15:41:57 +02:00
thomwolf
f289e6cfe4
fix docstrings
2019-07-16 15:31:21 +02:00
thomwolf
9726b229cf
model name typo
2019-07-16 15:17:45 +02:00
thomwolf
1849aa7d39
update readme and pretrained model weight files
2019-07-16 15:11:29 +02:00
thomwolf
43e0e8fa04
updates to readme and doc
2019-07-16 13:56:47 +02:00
thomwolf
f31154cb9d
Merge branch 'xlnet'
2019-07-16 11:51:13 +02:00
thomwolf
1b35d05d4b
update conversion scripts and __main__
2019-07-16 09:41:55 +02:00
thomwolf
352e3ff998
added migration guide to readme
2019-07-16 09:03:49 +02:00
thomwolf
8ad7e5b4f2
indeed
2019-07-16 00:29:15 +02:00
thomwolf
064d0a0b76
update readme
2019-07-16 00:21:33 +02:00
thomwolf
3b8b0e01bb
update readme
2019-07-16 00:12:55 +02:00
thomwolf
76da9765b6
fix run_generation test
2019-07-15 17:52:35 +02:00
thomwolf
e691fc0963
update QA models tests + run_generation
2019-07-15 17:45:24 +02:00
thomwolf
15d8b1266c
update tokenizer - update squad example for xlnet
2019-07-15 17:30:42 +02:00
thomwolf
3b469cb422
updating squad for compatibility with XLNet
2019-07-15 15:28:37 +02:00
thomwolf
8ca767f13c
clean up optimization
2019-07-15 13:49:07 +02:00
thomwolf
74a24f0fe9
clean up file_utils
2019-07-15 13:49:01 +02:00
thomwolf
ab49fafc04
update tokenization docstrings for #328
2019-07-15 12:51:23 +02:00
thomwolf
a9ab15174c
fix #328
2019-07-15 12:42:12 +02:00
thomwolf
f7cd7392fd
fixed tests
2019-07-15 12:32:19 +02:00
thomwolf
e28d8bde0d
doc on base classes
2019-07-15 12:08:06 +02:00