1826 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
thomwolf	f2a337b3ed	fix tokenization tests for gpt2 roberta	2019-09-26 09:02:43 +02:00
Thomas Wolf	4a233e5b2c	Merge pull request #1315 from bryant1410/patch-1 ... Remove unnecessary use of FusedLayerNorm	2019-09-26 08:50:02 +02:00
thomwolf	7a99e4b196	fix #1196 and fix #1285	2019-09-26 08:41:02 +02:00
thomwolf	7c9f8f93f9	fix tests	2019-09-26 01:59:53 +02:00
thomwolf	d6dde438ea	add batch dimension in encode	2019-09-26 01:45:55 +02:00
thomwolf	4a21c4d88d	add warning if neither pt nor tf are found	2019-09-26 01:30:06 +02:00
thomwolf	2967de06f4	adding intialization to bert	2019-09-25 22:08:38 +02:00
thomwolf	a6bcfb8015	fix tests	2019-09-25 21:14:12 +02:00
thomwolf	78863f6b36	fix tokenizer to tensors	2019-09-25 21:09:46 +02:00
thomwolf	8a618e0af5	clean up __init__	2019-09-25 21:04:52 +02:00
thomwolf	3b7fb48c3b	fix loading from tf/pt	2019-09-25 17:46:16 +02:00
thomwolf	a049c8043b	push fix to training	2019-09-25 17:33:16 +02:00
thomwolf	5def3302f4	update run_glue	2019-09-25 12:38:08 +02:00
thomwolf	f71758f7a4	update internal glue processors	2019-09-25 12:00:50 +02:00
thomwolf	0f091062d4	Merge branch 'glue-example' into tf2	2019-09-25 10:21:52 +02:00
thomwolf	c4acc3a8e9	let encode accept tensor inputs	2019-09-25 10:19:14 +02:00
Thomas Wolf	e8e956dbb2	Merge pull request #1327 from huggingface/tf2-determinism ... Pytorch/TF2 determinism	2019-09-24 22:49:57 +02:00
Thomas Wolf	e4022d96f7	Merge pull request #1325 from huggingface/glue-included ... [Proposal] GLUE processors included in library	2019-09-24 21:40:10 +02:00
LysandreJik	1761d2091a	Check to see if the models have the same results when in eval mode (pt) or when training=False (tf)	2019-09-24 14:59:10 -04:00
thomwolf	789ea72037	fix output_token_type in glue	2019-09-24 17:32:01 +02:00
thomwolf	1cbd566c63	Merge branch 'glue-example' into glue-included	2019-09-24 17:24:52 +02:00
thomwolf	743e383d4b	py2 fix	2019-09-24 17:21:54 +02:00
thomwolf	99a90e43d4	update data processors __init__	2019-09-24 17:16:46 +02:00
thomwolf	b5ec526f85	updated data processor and metrics	2019-09-24 17:10:50 +02:00
thomwolf	a6981076ec	various updates	2019-09-24 16:46:26 +02:00
LysandreJik	0b82e3d0d9	Relative imports	2019-09-24 09:52:25 -04:00
LysandreJik	f09e5ecef0	[Proposal] GLUE processors included in library	2019-09-24 09:47:34 -04:00
thomwolf	128bdd4c35	fix tests pt/tf	2019-09-24 15:43:39 +02:00
LysandreJik	72402d1acd	Fixed DistilBERT tokenizer	2019-09-24 09:41:14 -04:00
thomwolf	28a30af6d1	fix auto models	2019-09-24 15:33:39 +02:00
thomwolf	de203853cc	docstring for xlnet	2019-09-24 15:30:55 +02:00
thomwolf	559790f9e4	docstring for xlm	2019-09-24 15:26:57 +02:00
thomwolf	b3087ddde8	docstring t-xl	2019-09-24 15:21:51 +02:00
thomwolf	4761a39781	doctring roberta	2019-09-24 15:19:09 +02:00
thomwolf	45a6f2edd9	docstring for GPT	2019-09-24 15:15:47 +02:00
thomwolf	e7ba5bc85b	docstring for GPT2	2019-09-24 15:12:36 +02:00
LysandreJik	d340e2329e	create_mask_from_sequences -> create_token_type_ids_from_sequences	2019-09-24 09:09:28 -04:00
thomwolf	b94f73bab7	distilbert docstring	2019-09-24 15:06:51 +02:00
thomwolf	9678c49419	docstrings for bert	2019-09-24 14:57:05 +02:00
thomwolf	f3d1511b5b	fix imports	2019-09-24 14:42:09 +02:00
thomwolf	dd2d90f344	update automodels	2019-09-24 14:39:41 +02:00
thomwolf	ee261439a9	add save_pretrained	2019-09-24 14:30:28 +02:00
thomwolf	29bb3e4eb0	double loading ok	2019-09-24 14:23:46 +02:00
thomwolf	f5397ffc3b	update loading logics	2019-09-24 14:03:58 +02:00
thomwolf	271f213621	updating to load tf model in pt - fixing headmasking test	2019-09-24 13:51:28 +02:00
thomwolf	cf9c1cbb60	fix tests chen only using tf	2019-09-24 13:32:47 +02:00
thomwolf	2167e366ba	update circleCi	2019-09-24 13:27:45 +02:00
thomwolf	e9a103c17a	bidirectional conversion TF <=> PT - extended tests	2019-09-24 13:25:50 +02:00
LysandreJik	c832f43a4d	output_token_type -> token_type_ids	2019-09-24 07:21:38 -04:00
LysandreJik	3927d7756c	Updated the GLUE pre-processing method	2019-09-24 07:15:11 -04:00