151 Commits

Author	SHA1	Message	Date
VictorSanh	764a7923ec	add distillation+finetuning option in run_squad	2019-10-04 17:23:15 -04:00
thomwolf	31c23bd5ee	[BIG] pytorch-transformers => transformers	2019-09-26 10:15:53 +02:00
LysandreJik	de8e14b6c0	Added DistilBERT to run_squad script	2019-09-19 10:55:06 +02:00
Andreas Daiminger	1d15a7f278	swap order of optimizer.step() and scheduler.step()	2019-08-28 19:18:27 +02:00
VictorSanh	b006a7a12f	fix for squad	2019-08-22 00:25:42 -04:00
Peng Qi	3bffd2e8e5	more fixes	2019-08-20 10:59:28 -07:00
Peng Qi	a368b87791	Fix #1015	2019-08-19 13:07:00 -07:00
Chi-Liang Liu	40acf6b52a	don't save model without training	2019-08-18 05:02:25 -04:00
Thomas Wolf	d43dc48b34	Merge branch 'master' into auto_models	2019-08-05 19:17:35 +02:00
thomwolf	70c10caa06	add option mentioned in #940	2019-08-05 17:09:37 +02:00
thomwolf	b90e29d52c	working on automodels	2019-08-05 16:06:34 +02:00
Thomas Wolf	c054b5ee64	Merge pull request #896 from zijunsun/master ... fix multi-gpu training bug when using fp16	2019-07-26 19:31:02 +02:00
zijunsun	f0aeb7a814	multi-gpu training also should be after apex fp16（squad）	2019-07-26 15:23:29 +08:00
Chi-Liang Liu	a7fce6d917	fix squad v1 error (na_prob_file should be None)	2019-07-24 16:11:36 +08:00
thomwolf	6070b55443	fix #868	2019-07-23 17:46:01 +02:00
Peiqin Lin	76be189b08	typos	2019-07-21 20:39:42 +08:00
thomwolf	71d597dad0	fix #800	2019-07-17 13:51:09 +02:00
thomwolf	15d8b1266c	update tokenizer - update squad example for xlnet	2019-07-15 17:30:42 +02:00
thomwolf	3b469cb422	updating squad for compatibility with XLNet	2019-07-15 15:28:37 +02:00
thomwolf	2397f958f9	updating examples and doc	2019-07-14 23:20:10 +02:00
thomwolf	936e813c84	clean up examples - added squad example and test	2019-07-12 14:16:06 +02:00
thomwolf	762ded9b1c	wip examples	2019-07-12 11:28:52 +02:00
thomwolf	50b7e52a7f	WIP examples	2019-07-10 15:33:34 +02:00
thomwolf	36bca545ff	tokenization abstract class - tests for examples	2019-07-05 15:02:59 +02:00
thomwolf	f6081f2255	add xlnetforsequence classif and run_classifier example for xlnet	2019-06-24 10:01:07 +02:00
thomwolf	68ab9599ce	small fix and updates to readme	2019-06-19 09:38:38 +02:00
thomwolf	f7e2ac01ea	update barrier	2019-06-18 22:43:35 +02:00
thomwolf	7d2001aa44	overwrite_output_dir	2019-06-18 22:13:30 +02:00
thomwolf	15ebd67d4e	cache in run_classifier + various fixes to the examples	2019-06-18 15:58:22 +02:00
thomwolf	e6e5f19257	fix	2019-06-18 14:45:14 +02:00
thomwolf	a432b3d466	distributed traing t_total	2019-06-18 14:39:09 +02:00
thomwolf	c5407f343f	split squad example in two	2019-06-18 14:29:03 +02:00
thomwolf	335f57baf8	only on main process	2019-06-18 14:03:46 +02:00
thomwolf	326944d627	add tensorboard to run_squad	2019-06-18 14:02:42 +02:00
thomwolf	d82e5deeb1	set find_unused_parameters=True in DDP	2019-06-18 12:13:14 +02:00
thomwolf	a59abedfb5	DDP update	2019-06-18 12:06:26 +02:00
thomwolf	2ef5e0de87	switch to pytorch DistributedDataParallel	2019-06-18 12:03:13 +02:00
thomwolf	9ce37af99b	oups	2019-06-18 11:47:54 +02:00
thomwolf	a40955f071	no need to duplicate models anymore	2019-06-18 11:46:14 +02:00
Thomas Wolf	277c77f1c5	Merge pull request #630 from tguens/master ... Update run_squad.py	2019-06-14 16:56:26 +02:00
tguens	9e7bc51b95	Update run_squad.py ... Indentation change so that the output "nbest_predictions.json" is not empty.	2019-05-22 17:27:59 +08:00
samuelbroscheit	94247ad6cb	Make num_train_optimization_steps int	2019-05-13 12:38:22 +02:00
samuel.broscheit	49a77ac16f	Clean up a little bit	2019-05-12 00:31:10 +02:00
samuel.broscheit	3bf3f9596f	Fixing the issues reported in https://github.com/huggingface/pytorch-pretrained-BERT/issues/556 ... Reason for issue was that optimzation steps where computed from example size, which is different from actual size of dataloader when an example is chunked into multiple instances. Solution in this pull request is to compute num_optimization_steps directly from len(data_loader).	2019-05-12 00:13:45 +02:00
burcturkoglu	00c7fd2b79	Division to num_train_optimizer of global_step in lr_this_step is removed.	2019-05-09 10:57:03 +03:00
burcturkoglu	fa37b4da77	Merge branch 'master' of https://github.com/huggingface/pytorch-pretrained-BERT	2019-05-09 10:55:24 +03:00
burcturkoglu	5289b4b9e0	Division to num_train_optimizer of global_step in lr_this_step is removed.	2019-05-09 10:51:38 +03:00
MottoX	74dbba64bc	Prepare optimizer only when args.do_train is True	2019-05-02 19:09:29 +08:00
thomwolf	d94c6b0144	fix training schedules in examples to match new API	2019-04-23 11:17:06 +02:00
thomwolf	3571187ef6	fix saving models in distributed setting examples	2019-04-15 16:43:56 +02:00
thomwolf	2499b0a5fc	add ptvsd to run_squad	2019-04-15 15:33:04 +02:00
thomwolf	7816f7921f	clean up distributed training logging in run_squad example	2019-04-15 15:27:10 +02:00
thomwolf	1135f2384a	clean up logger in examples for distributed case	2019-04-15 15:22:40 +02:00
thomwolf	60ea6c59d2	added best practices for serialization in README and examples	2019-04-15 15:00:33 +02:00
thomwolf	179a2c2ff6	update example to work with new serialization semantic	2019-04-15 14:33:23 +02:00
thomwolf	846b1fd6f8	Fix #419	2019-04-03 10:50:38 +02:00
Yongbo Wang	d1e4fa98a9	typo in annotation ... modify `heruistic` to `heuristic` in line 660, `charcter` to `character` in line 661.	2019-03-14 17:32:15 +08:00
Yongbo Wang	3d6452163d	typo ... modify `mull` to `null` in line 474 annotation.	2019-03-14 17:03:38 +08:00
thomwolf	a98dfe4ced	fixing #377 (empty nbest_predictions.json)	2019-03-14 09:57:06 +01:00
thomwolf	994d86609b	fixing PYTORCH_PRETRAINED_BERT_CACHE use in examples	2019-03-06 10:21:24 +01:00
thomwolf	5c85fc3977	fix typo - logger info	2019-03-06 10:05:21 +01:00
wlhgtc	8efaf8f176	fix 'best_non_null_entry' is None error	2019-02-15 15:57:25 +08:00
thomwolf	d38caba169	typo in run_squad	2019-02-11 14:10:27 +01:00
thomwolf	af62cc5f20	fix run_squad example	2019-02-11 14:06:32 +01:00
thomwolf	eebc8abbe2	clarify and unify model saving logic in examples	2019-02-11 14:04:19 +01:00
Thomas Wolf	848aae49e1	Merge branch 'master' into python_2	2019-02-06 00:13:20 +01:00
thomwolf	448937c00d	python 2 compatibility	2019-02-06 00:07:46 +01:00
thomwolf	d609ba24cb	resolving merge conflicts	2019-02-05 16:14:25 +01:00
Thomas Wolf	64ce900974	Merge pull request #248 from JoeDumoulin/squad1.1-fix ... fix prediction on run-squad.py example	2019-02-05 16:00:51 +01:00
Thomas Wolf	e9e77cd3c4	Merge pull request #218 from matej-svejda/master ... Fix learning rate problems in run_classifier.py	2019-02-05 15:40:44 +01:00
thomwolf	1579c53635	more explicit notation: num_train_step => num_train_optimization_steps	2019-02-05 15:36:33 +01:00
joe dumoulin	aa90e0c36a	fix prediction on run-squad.py example	2019-02-01 10:15:44 -08:00
Surya Kasturi	9bf528877e	Update run_squad.py	2019-01-30 15:09:31 -05:00
Matej Svejda	5169069997	make examples consistent, revert error in num_train_steps calculation	2019-01-30 11:47:25 +01:00
Matej Svejda	9c6a48c8c3	fix learning rate/fp16 and warmup problem for all examples	2019-01-27 14:07:24 +01:00
Sang-Kil Park	64326dccfb	Fix it to run properly even if without --do_train param. ... It was modified similar to `run_classifier.py`, and Fixed to run properly even if without `--do_train` param.	2019-01-10 21:51:39 +09:00
thomwolf	2e4db64cab	add do_lower_case tokenizer loading optino in run_squad and ine_tuning examples	2019-01-07 13:06:42 +01:00
thomwolf	c9fd350567	remove default when action is store_true in arguments	2019-01-07 13:01:54 +01:00
Thomas Wolf	d3d56f9a0b	Merge pull request #166 from likejazz/patch-1 ... Fix error when `bert_model` param is path or url.	2019-01-07 12:40:55 +01:00
Sang-Kil Park	ca4e7aaa72	Fix error when bert_model param is path or url. ... Error occurs when `bert_model` param is path or url. Therefore, if it is path, specify the last path to prevent error.	2019-01-05 11:42:54 +09:00
Grégory Châtel	186f75342e	Adding new pretrained model to the help of the bert_model argument.	2019-01-02 14:00:59 +01:00
thomwolf	ae88eb88a4	set encoding to 'utf-8' in calls to open	2018-12-14 13:48:58 +01:00
thomwolf	e1eab59aac	no fp16 on evaluation	2018-12-13 14:54:02 +01:00
thomwolf	087798b7fa	fix reloading model for evaluation in examples	2018-12-13 14:48:12 +01:00
thomwolf	0cf88ff084	make examples work without apex	2018-12-13 13:28:00 +01:00
thomwolf	d3fcec1a3e	add saving and loading model in examples	2018-12-13 12:50:44 +01:00
thomwolf	b3caec5a56	adding save checkpoint and loading in examples	2018-12-13 12:48:13 +01:00
Deyu Fu	c8ea286048	change to apex for better fp16 and multi-gpu support	2018-12-11 17:13:58 -08:00
Grégory Châtel	fa7daa247d	Fixing the commentary of the SquadExample class.	2018-12-06 13:14:33 +01:00
thomwolf	257a35134a	fix pickle dump in run_squad example	2018-11-30 14:23:09 +01:00
Li Li	0aaedcc02f	Bug fix in examples;correct t_total for distributed training;run prediction for full dataset	2018-11-27 01:08:37 -08:00
thomwolf	32167cdf4b	remove convert_to_unicode and printable_text from examples	2018-11-26 23:33:22 +01:00
thomwolf	05053d163c	update cache_dir in readme and examples	2018-11-26 10:45:13 +01:00
thomwolf	6b2136a8a9	fixing weights decay in run_squad example	2018-11-20 10:12:44 +01:00
thomwolf	2f21497d3e	fixing param.grad is None in fp16 examples	2018-11-20 10:01:21 +01:00
thomwolf	aa50fd196f	remove unused arguments in example scripts	2018-11-17 23:01:05 +01:00
thomwolf	47a7d4ec14	update examples from master	2018-11-17 12:21:35 +01:00
thomwolf	757750d6f6	fix tests	2018-11-17 11:58:14 +01:00
thomwolf	4e46affc34	updating examples	2018-11-17 10:30:54 +01:00
thomwolf	cba85a67b9	fix nan in optimizer_on_cpu	2018-11-15 21:47:41 +01:00