104 Commits

Author	SHA1	Message	Date
thomwolf	32fea876bb	add distant debugging to run_transfo_xl	2019-02-11 12:53:32 +01:00
thomwolf	b31ba23913	cuda on in the examples by default	2019-02-11 12:15:43 +01:00
thomwolf	6cd769957e	update transfo xl example	2019-02-09 16:59:17 +01:00
thomwolf	1320e4ec0c	mc_token_mask => mc_token_ids	2019-02-09 16:58:53 +01:00
thomwolf	f4a07a392c	mems not splitted	2019-02-09 16:14:31 +01:00
thomwolf	43b9af0cac	mems initialized to None in run_transfo	2019-02-09 16:12:19 +01:00
thomwolf	b80684b23f	fixing run openai gpt example	2019-02-08 22:31:32 +01:00
thomwolf	7b4b0cf966	logging	2019-02-08 11:16:29 +01:00
thomwolf	4bbb9f2d68	log loss - helpers	2019-02-08 11:14:29 +01:00
thomwolf	5d7e845712	fix model on cuda	2019-02-08 11:08:43 +01:00
thomwolf	eccb2f0163	hot fix	2019-02-08 11:05:20 +01:00
thomwolf	5adc20723b	add distant debugging	2019-02-08 11:03:59 +01:00
thomwolf	777459b471	run openai example running	2019-02-08 10:33:14 +01:00
thomwolf	6bc082da0a	updating examples	2019-02-08 00:02:26 +01:00
thomwolf	e77721e4fe	renamed examples	2019-02-07 23:15:15 +01:00
thomwolf	d482e3d79d	adding examples for openai and transformer-xl	2019-02-07 17:06:41 +01:00
thomwolf	ed47cb6cba	fixing transfo eval script	2019-02-06 16:22:17 +01:00
Thomas Wolf	848aae49e1	Merge branch 'master' into python_2	2019-02-06 00:13:20 +01:00
thomwolf	448937c00d	python 2 compatibility	2019-02-06 00:07:46 +01:00
thomwolf	d609ba24cb	resolving merge conflicts	2019-02-05 16:14:25 +01:00
Thomas Wolf	64ce900974	Merge pull request #248 from JoeDumoulin/squad1.1-fix ... fix prediction on run-squad.py example	2019-02-05 16:00:51 +01:00
Thomas Wolf	e9e77cd3c4	Merge pull request #218 from matej-svejda/master ... Fix learning rate problems in run_classifier.py	2019-02-05 15:40:44 +01:00
thomwolf	1579c53635	more explicit notation: num_train_step => num_train_optimization_steps	2019-02-05 15:36:33 +01:00
joe dumoulin	aa90e0c36a	fix prediction on run-squad.py example	2019-02-01 10:15:44 -08:00
Thomas Wolf	8f8bbd4a4c	Merge pull request #244 from deepset-ai/prettify_lm_masking ... Avoid confusion of inplace LM masking	2019-02-01 12:17:50 +01:00
tholor	ce75b169bd	avoid confusion of inplace masking of tokens_a / tokens_b	2019-01-31 11:42:06 +01:00
Surya Kasturi	9bf528877e	Update run_squad.py	2019-01-30 15:09:31 -05:00
Surya Kasturi	af2b78601b	Update run_squad2.py	2019-01-30 15:08:56 -05:00
Matej Svejda	5169069997	make examples consistent, revert error in num_train_steps calculation	2019-01-30 11:47:25 +01:00
Matej Svejda	9c6a48c8c3	fix learning rate/fp16 and warmup problem for all examples	2019-01-27 14:07:24 +01:00
Matej Svejda	01ff4f82ba	learning rate problems in run_classifier.py	2019-01-22 23:40:06 +01:00
liangtaiwan	be9fa192f0	don't save if do not train	2019-01-18 00:41:55 +08:00
thomwolf	a28dfc8659	fix eval for wt103	2019-01-16 11:18:19 +01:00
thomwolf	8831c68803	fixing various parts of model conversion, loading and weights sharing	2019-01-16 10:31:16 +01:00
thomwolf	bcd4aa8fe0	update evaluation example	2019-01-15 23:32:34 +01:00
thomwolf	a69ec2c722	improved corpus and tokenization conversion - added evaluation script	2019-01-15 23:17:46 +01:00
Thomas Wolf	4e0cba1053	Merge pull request #191 from nhatchan/20190113_py35_finetune ... lm_finetuning compatibility with Python 3.5	2019-01-14 09:40:07 +01:00
nhatchan	6c65cb2492	lm_finetuning compatibility with Python 3.5 ... dicts are not ordered in Python 3.5 or prior, which is a cause of #175. This PR replaces one with a list, to keep its order.	2019-01-13 21:09:13 +09:00
Li Dong	a2da2b4109	[bug fix] args.do_lower_case is always True ... The "default=True" makes args.do_lower_case always True. ```python parser.add_argument("--do_lower_case", default=True, action='store_true') ```	2019-01-13 19:51:11 +08:00
tholor	506e5bb0c8	add do_lower_case arg and adjust model saving for lm finetuning.	2019-01-11 08:32:46 +01:00
Thomas Wolf	e485829a41	Merge pull request #174 from abeljim/master ... Added Squad 2.0	2019-01-10 23:40:45 +01:00
Sang-Kil Park	64326dccfb	Fix it to run properly even if without --do_train param. ... It was modified similar to `run_classifier.py`, and Fixed to run properly even if without `--do_train` param.	2019-01-10 21:51:39 +09:00
thomwolf	e5c78c6684	update readme and few typos	2019-01-10 01:40:00 +01:00
thomwolf	fa5222c296	update readme	2019-01-10 01:25:28 +01:00
Unknown	b3628f117e	Added Squad 2.0	2019-01-08 15:13:13 -08:00
thomwolf	ab90d4cddd	adding docs and example for OpenAI GPT	2019-01-09 00:12:43 +01:00
thomwolf	2e4db64cab	add do_lower_case tokenizer loading optino in run_squad and ine_tuning examples	2019-01-07 13:06:42 +01:00
thomwolf	c9fd350567	remove default when action is store_true in arguments	2019-01-07 13:01:54 +01:00
Thomas Wolf	d3d56f9a0b	Merge pull request #166 from likejazz/patch-1 ... Fix error when `bert_model` param is path or url.	2019-01-07 12:40:55 +01:00
Thomas Wolf	766c6b2ce3	Merge pull request #159 from jaderabbit/master ... Allow do_eval to be used without do_train and to use the pretrained model in the output folder	2019-01-07 12:31:06 +01:00