thomwolf
0740e63e49
updating schedules for state_dict saving
2019-07-23 15:57:18 +02:00
Thomas Wolf
268c6cc160
Merge pull request #845 from rabeehk/master
...
fixed version issues in run_openai_gpt
2019-07-23 15:29:31 +02:00
Thomas Wolf
1d7d01c080
Merge pull request #847 from lpq29743/master
...
typos
2019-07-23 15:28:31 +02:00
Thomas Wolf
c4bc66886d
Merge pull request #860 from Yiqing-Zhou/patch-1
...
read().splitlines() -> readlines()
2019-07-23 15:24:25 +02:00
thomwolf
ba52fe69d5
update breaking change section regarding from_pretrained keyword arguments
2019-07-23 15:10:02 +02:00
Yiqing-Zhou
b1019d2a8e
token[-1] -> token.rstrip('\n')
2019-07-23 20:41:26 +08:00
thomwolf
0227b4a940
fix #827
2019-07-23 14:06:43 +02:00
Anish Moorthy
490ebbdcf7
Fix PretrainedModel.from_pretrained not passing cache_dir forward
2019-07-22 18:03:08 -04:00
Anish Moorthy
b8009cb0da
Make PreTrainedModel.from_pretrained pass unused arguments to model
2019-07-22 18:03:08 -04:00
Yiqing-Zhou
bef0c629ca
fix
...
Remove '\n' before adding token into vocab
2019-07-22 22:30:49 +08:00
Yiqing-Zhou
897d0841be
read().splitlines() -> readlines()
...
splitlines() does not work as what we expect here for bert-base-chinese because there is a '\u2028' (unicode line seperator) token in vocab file. Value of '\u2028'.splitlines() is ['', ''].
Perhaps we should use readlines() instead.
2019-07-22 20:49:09 +08:00
rish-16
2f869dc665
Fixed typo
2019-07-21 11:05:36 -04:00
Peiqin Lin
76be189b08
typos
2019-07-21 20:39:42 +08:00
Rabeeh KARIMI
f63ff536ad
fixed version issues in run_openai_gpt
2019-07-20 12:43:07 +02:00
Thomas Wolf
a615499076
Merge pull request #797 from yzy5630/fix-examples
...
fix some errors for distributed lm_finetuning
2019-07-18 23:32:33 +02:00
Thomas Wolf
dbecfcf321
Merge pull request #815 from praateekmahajan/update-readme-link
...
Update Readme link for Fine Tune/Usage section
2019-07-18 18:30:32 +02:00
Peiqin Lin
acc48a0cc9
typos
2019-07-18 09:54:04 -04:00
yzy5630
a1fe4ba9c9
use new API for save and load
2019-07-18 15:45:23 +08:00
Praateek Mahajan
0d46b17553
Update Readme
...
Incorrect link for `Quick tour: Fine-tuning/usage scripts`
2019-07-17 22:50:10 -07:00
yzy5630
a7ba27b1b4
add parser for adam
2019-07-18 08:52:51 +08:00
Wei-Sheng Chin
c4e9615691
Fix a path so that test can run on Windows
2019-07-17 09:08:40 -07:00
LysandreJik
9d381e7be9
Fixed incorrect links in the PretrainedModel
2019-07-17 09:25:38 -04:00
yzy5630
d6522e2873
change loss and optimizer to new API
2019-07-17 21:22:34 +08:00
thomwolf
71d597dad0
fix #800
2019-07-17 13:51:09 +02:00
Thomas Wolf
4bcddf6fc8
Merge pull request #801 from bzantium/master
...
import sys twice
2019-07-17 12:31:26 +02:00
Thomas Wolf
506ab34d0e
Merge pull request #796 from stefan-it/minor-doc-updates
...
Minor documentation updates
2019-07-17 12:26:34 +02:00
Minho Ryu
cd8980e1f4
import sys twice
2019-07-17 18:12:01 +09:00
yzy5630
123da5a2fa
fix errors for lm_finetuning examples
2019-07-17 09:56:07 +08:00
yzy5630
60a1bdcdac
fix some errors for distributed lm_finetuning
2019-07-17 09:16:20 +08:00
Stefan Schweter
e6cc6d237f
docs: fix link to various notebooks
2019-07-16 23:42:28 +02:00
Stefan Schweter
5b78400e21
docs: fix link to modeling example source (bert)
2019-07-16 23:41:57 +02:00
Stefan Schweter
61cc3ee350
docs: fix link to tf checkpoint to pytorch script
2019-07-16 23:41:04 +02:00
Stefan Schweter
dbbd94cb7a
docs: fix link to bertology example and update dataset description
2019-07-16 23:40:04 +02:00
thomwolf
5fe0b378d8
adding missing docstring fix #793
2019-07-16 21:35:53 +02:00
thomwolf
e848b54730
fix #792
2019-07-16 21:22:19 +02:00
thomwolf
c5b3d86a91
Merge branch 'master' of https://github.com/huggingface/pytorch-pretrained-BERT
2019-07-16 21:21:05 +02:00
thomwolf
6b70760204
typos
2019-07-16 21:21:03 +02:00
LysandreJik
117ed92992
RestructuredText table for pretrained models.
2019-07-16 11:58:47 -04:00
Thomas Wolf
b33a385091
update readme
2019-07-16 16:18:37 +02:00
thomwolf
ed7549bb1a
release version 1.0
2019-07-16 16:10:58 +02:00
thomwolf
6a72d9aa52
updated examples in readme
2019-07-16 16:09:29 +02:00
thomwolf
b59043bf8f
update readme
2019-07-16 16:03:48 +02:00
thomwolf
edc79acb3b
simpler quick tour
2019-07-16 16:02:32 +02:00
thomwolf
5c82d3488f
indicate default evaluation in breaking changes
2019-07-16 15:45:58 +02:00
thomwolf
4acaa65068
model in evaluation mode by default after from_pretrained
2019-07-16 15:41:57 +02:00
thomwolf
f289e6cfe4
fix docstrings
2019-07-16 15:31:21 +02:00
thomwolf
9726b229cf
model name typo
2019-07-16 15:17:45 +02:00
thomwolf
1849aa7d39
update readme and pretrained model weight files
2019-07-16 15:11:29 +02:00
thomwolf
43e0e8fa04
updates to readme and doc
2019-07-16 13:56:47 +02:00
thomwolf
f31154cb9d
Merge branch 'xlnet'
2019-07-16 11:51:13 +02:00