15053 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
thomwolf	c306869ea2	add two transformer xl models	2019-02-07 17:07:03 +01:00
thomwolf	d482e3d79d	adding examples for openai and transformer-xl	2019-02-07 17:06:41 +01:00
thomwolf	9c3c24800b	split saved model in config & weights	2019-02-07 17:06:17 +01:00
thomwolf	2df41663f1	added test	2019-02-07 17:05:49 +01:00
tholor	9aebc711c9	adjust error message related to args.do_eval	2019-02-07 11:49:38 +01:00
tholor	4a450b25d5	removing unused argument eval_batch_size from LM finetuning #256	2019-02-07 10:06:38 +01:00
Thomas Wolf	58f0a2745c	Merge pull request #258 from BoeingX/master ... Fix the undefined variable in squad example	2019-02-06 20:33:18 +01:00
Baoyang Song	7ac3311e48	Fix the undefined variable in squad example	2019-02-06 19:36:08 +01:00
thomwolf	ed47cb6cba	fixing transfo eval script	2019-02-06 16:22:17 +01:00
thomwolf	973926431e	fix differencies with tensorflow version (mem cells and adaptive sofmax clusters)	2019-02-06 15:42:29 +01:00
thomwolf	ba9e4eb354	fix unicode in tokenization tests	2019-02-06 00:28:00 +01:00
thomwolf	34bdb7f9cb	update circle-ci for python 2.7 and 3.5	2019-02-06 00:25:12 +01:00
Thomas Wolf	848aae49e1	Merge branch 'master' into python_2	2019-02-06 00:13:20 +01:00
thomwolf	448937c00d	python 2 compatibility	2019-02-06 00:07:46 +01:00
thomwolf	ba37ddc5ce	fix run_lm_modeling example command line	2019-02-06 00:07:08 +01:00
thomwolf	822915142b	fix docstring	2019-02-05 16:34:32 +01:00
Thomas Wolf	bd74632687	Merge pull request #251 from Iwontbecreative/active_loss_tok_classif ... Only keep the active part mof the loss for token classification	2019-02-05 16:33:45 +01:00
Thomas Wolf	fd223374f0	Merge pull request #208 from Liangtaiwan/mergesquad ... Merge run_squad.py and run_squad2.py	2019-02-05 16:15:03 +01:00
thomwolf	d609ba24cb	resolving merge conflicts	2019-02-05 16:14:25 +01:00
thomwolf	bde1eeebe0	rename	2019-02-05 16:11:22 +01:00
thomwolf	3ea3b00e59	merge squad example in single example	2019-02-05 16:10:27 +01:00
thomwolf	d8e3bdbb4c	moved up to current master	2019-02-05 16:09:39 +01:00
Thomas Wolf	64ce900974	Merge pull request #248 from JoeDumoulin/squad1.1-fix ... fix prediction on run-squad.py example	2019-02-05 16:00:51 +01:00
thomwolf	0ad9b239a1	gitignore	2019-02-05 15:43:11 +01:00
Thomas Wolf	e9e77cd3c4	Merge pull request #218 from matej-svejda/master ... Fix learning rate problems in run_classifier.py	2019-02-05 15:40:44 +01:00
thomwolf	1579c53635	more explicit notation: num_train_step => num_train_optimization_steps	2019-02-05 15:36:33 +01:00
Thibault Fevry	f3bda2352a	Only keep the active part mof the loss for token classification	2019-02-04 11:46:36 -05:00
thomwolf	6179f537a3	clean up tokenization spaces	2019-02-04 17:41:22 +01:00
thomwolf	850da1cc36	strip decoded outputs	2019-02-04 17:35:05 +01:00
thomwolf	01a3966bc6	more options on special tokens	2019-02-04 17:26:25 +01:00
thomwolf	05f961840b	logging	2019-02-04 13:06:19 +01:00
joe dumoulin	aa90e0c36a	fix prediction on run-squad.py example	2019-02-01 10:15:44 -08:00
Thomas Wolf	8f8bbd4a4c	Merge pull request #244 from deepset-ai/prettify_lm_masking ... Avoid confusion of inplace LM masking	2019-02-01 12:17:50 +01:00
Thomas Wolf	e2d53d95b0	Merge pull request #242 from ksurya/argparse ... Fix argparse type error	2019-02-01 12:14:55 +01:00
Thomas Wolf	7e0b415ab4	Merge pull request #240 from girishponkiya/patch-1 ... Minor update in README	2019-02-01 12:14:05 +01:00
tholor	ce75b169bd	avoid confusion of inplace masking of tokens_a / tokens_b	2019-01-31 11:42:06 +01:00
Surya Kasturi	9bf528877e	Update run_squad.py	2019-01-30 15:09:31 -05:00
Surya Kasturi	af2b78601b	Update run_squad2.py	2019-01-30 15:08:56 -05:00
Girishkumar	0dd2b750ca	Minor update in README ... Update links to classes in `modeling.py`	2019-01-30 23:49:15 +05:30
Matej Svejda	5169069997	make examples consistent, revert error in num_train_steps calculation	2019-01-30 11:47:25 +01:00
thomwolf	3a848111e6	update config, docstrings and readme to switch to seperated tokens and position embeddings	2019-01-29 11:00:11 +01:00
thomwolf	98c96fb1a7	splitting position and tokens embeddings in OpenAI GPT - updating tf imports - tests	2019-01-29 10:31:42 +01:00
thomwolf	5456d82311	more versatile model loading	2019-01-29 09:54:18 +01:00
thomwolf	9b2540b5a7	update __init__	2019-01-29 09:54:08 +01:00
thomwolf	bd3b3aee9c	update	2019-01-28 17:47:29 +01:00
thomwolf	a45a9cc0e1	update tests	2019-01-28 17:16:02 +01:00
thomwolf	b12616fd8e	updating code organization to fix imports	2019-01-28 17:03:39 +01:00
thomwolf	d77dd62ff8	directly load from TF checkpoints + code cleanup	2019-01-28 16:50:23 +01:00
Matej Svejda	9c6a48c8c3	fix learning rate/fp16 and warmup problem for all examples	2019-01-27 14:07:24 +01:00
Matej Svejda	01ff4f82ba	learning rate problems in run_classifier.py	2019-01-22 23:40:06 +01:00