15053 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
LysandreJik	ec6fb25c21	Patch documentation	2019-12-10 15:49:20 -05:00
LysandreJik	418589244d	Uniforming the ignored indices	2019-12-10 15:26:19 -05:00
Leo Dirac	58d75aa310	Progress indicator improvements when downloading pre-trained models.	2019-12-10 11:36:56 -08:00
LysandreJik	6a73382706	Complete warning + cleanup	2019-12-10 14:33:24 -05:00
Lysandre	dc4e9e5cb3	DataParallel for SQuAD + fix XLM	2019-12-10 19:21:20 +00:00
thomwolf	67a8be8e90	fix backward in tests	2019-12-10 17:50:32 +01:00
Rémi Louf	07bc8efbc3	add greedy decoding and sampling	2019-12-10 17:27:50 +01:00
Morgan Funtowicz	63e36007ee	Make sure padding, cls and another non-context tokens cannot appear in the answer.	2019-12-10 16:47:35 +01:00
thomwolf	f2538c1274	all tests in torch no grad	2019-12-10 16:33:11 +01:00
thomwolf	a5df980c5b	updating distilbert test	2019-12-10 16:01:15 +01:00
Morgan Funtowicz	40a39ab650	Reuse recent SQuAD refactored data structure inside QA pipelines.	2019-12-10 15:59:38 +01:00
thomwolf	7c3a15ace9	Merge branch 'master' into t5	2019-12-10 15:36:54 +01:00
thomwolf	981a5c8c17	updating models urls	2019-12-10 15:36:19 +01:00
Thomas Wolf	e6cff60b4c	Merge pull request #2069 from huggingface/cleaner-pt-tf-conversion ... clean up PT <=> TF conversion	2019-12-10 15:34:08 +01:00
Rémi Louf	4b82c485de	remove misplaced summarization documentation	2019-12-10 09:13:33 -05:00
thomwolf	8ae1044f80	updating tests and TF 2.0 model	2019-12-10 15:11:07 +01:00
Morgan Funtowicz	aae74065df	Added QuestionAnsweringPipeline unit tests.	2019-12-10 13:37:20 +01:00
Morgan Funtowicz	a7d3794a29	Remove token_type_ids for compatibility with DistilBert	2019-12-10 13:37:20 +01:00
Morgan Funtowicz	fe0f552e00	Use attention_mask everywhere.	2019-12-10 13:37:20 +01:00
Morgan Funtowicz	348e19aa21	Expose attention_masks and input_lengths arguments to batch_encode_plus	2019-12-10 13:37:18 +01:00
Morgan Funtowicz	c2407fdd88	Enable the Tensorflow backend.	2019-12-10 13:37:14 +01:00
Morgan Funtowicz	f116cf599c	Allow hidding frameworks through environment variables (NO_TF, NO_TORCH).	2019-12-10 13:37:07 +01:00
Morgan Funtowicz	6e61e06051	batch_encode_plus generates the encoder_attention_mask to avoid attending over padded values.	2019-12-10 13:37:07 +01:00
Morgan Funtowicz	02110485b0	Added batching, topk, chars index and scores.	2019-12-10 13:36:55 +01:00
Morgan Funtowicz	e1d89cb24d	Added QuestionAnsweringPipeline with batch support.	2019-12-10 13:36:55 +01:00
thomwolf	0558c9cb9b	Merge branch 'master' into t5	2019-12-10 12:58:48 +01:00
Morgan Funtowicz	81babb227e	Added download command through the cli. ... It allows to predownload models and tokenizers.	2019-12-10 12:18:59 +01:00
thomwolf	31a3a73ee3	updating CLI	2019-12-10 12:18:59 +01:00
thomwolf	7c1697562a	compatibility with sklearn and keras	2019-12-10 12:12:22 +01:00
thomwolf	b81ab431f2	updating AutoModels and AutoConfiguration - adding pipelines	2019-12-10 12:11:33 +01:00
thomwolf	2d8559731a	add pipeline - train	2019-12-10 11:34:16 +01:00
thomwolf	72c36b9ea2	[WIP] - CLI	2019-12-10 11:33:14 +01:00
Thomas Wolf	e57d00ee10	Merge pull request #1984 from huggingface/squad-refactor ... [WIP] Squad refactor	2019-12-10 11:07:26 +01:00
Thomas Wolf	ecabbf6d28	Merge pull request #2107 from huggingface/encoder-mask-shape ... create encoder attention mask from shape of hidden states	2019-12-10 10:07:56 +01:00
thomwolf	608a8f5b56	updating tf 2.0 layer_norm to T5 layer norm	2019-12-10 10:01:01 +01:00
Suvrat Bhooshan	df3961121f	Add MMBT Model to Transformers Repo	2019-12-09 18:36:48 -08:00
Julien Chaumond	1d18930462	Harmonize no_cuda flag with other scripts	2019-12-09 20:37:55 -05:00
Rémi Louf	f7eba09007	clean for release	2019-12-09 20:37:55 -05:00
Rémi Louf	2a64107e44	improve device usage	2019-12-09 20:37:55 -05:00
Rémi Louf	c0707a85d2	add README	2019-12-09 20:37:55 -05:00
Rémi Louf	ade3cdf5ad	integrate ROUGE	2019-12-09 20:37:55 -05:00
Rémi Louf	076602bdc4	prevent BERT weights from being downloaded twice	2019-12-09 20:37:55 -05:00
Rémi Louf	5909f71028	add py-rouge dependency	2019-12-09 20:37:55 -05:00
Rémi Louf	a1994a71ee	simplified model and configuration	2019-12-09 20:37:55 -05:00
Rémi Louf	3a9a9f7861	default output dir to documents dir	2019-12-09 20:37:55 -05:00
Rémi Louf	693606a75c	update the docs	2019-12-09 20:37:55 -05:00
Rémi Louf	c0443df593	remove beam search	2019-12-09 20:37:55 -05:00
Rémi Louf	2403a66598	give transformers API to BertAbs	2019-12-09 20:37:55 -05:00
Rémi Louf	4d18199902	cast bool tensor to long for pytorch < 1.3	2019-12-09 20:37:55 -05:00
Rémi Louf	9f75565ea8	setup training	2019-12-09 20:37:55 -05:00