15053 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Morgan Funtowicz	a096e2a88b	WIP serving through HTTP internally using pipelines.	2019-12-16 16:38:02 +01:00
Stefan Schweter	71b4750517	examples: add support for XLM-RoBERTa to run_ner script	2019-12-16 16:37:27 +01:00
Morgan Funtowicz	43a4e1bbe4	Adressing issue in varargs handling for question answering.	2019-12-16 16:00:41 +01:00
Morgan Funtowicz	46ccbb42fc	Make CLI run command use integer mapping for device argument.	2019-12-16 15:49:41 +01:00
Morgan Funtowicz	bbc707cf39	Fix non-keyworded varargs handling in DefaultArgumentHandler for pipeline.	2019-12-16 15:49:09 +01:00
Morgan Funtowicz	9c391277cc	Allow tensors placement on specific device through CLI and pipeline.	2019-12-16 15:19:13 +01:00
thomwolf	1bbdbacd5b	update __init__ and saving	2019-12-16 14:38:20 +01:00
Morgan Funtowicz	955d7ecb57	Refactored Pipeline with dedicated argument handler.	2019-12-16 14:34:54 +01:00
thomwolf	031ad4eb37	improving JSON error messages (for model card and configurations)	2019-12-16 14:20:57 +01:00
thomwolf	db0a9ee6e0	adding albert to TF auto models cc @LysandreJik	2019-12-16 14:08:08 +01:00
thomwolf	a4d07b983a	dict of all config and model files cc @LysandreJik	2019-12-16 14:00:32 +01:00
thomwolf	d3418a94ff	update tests	2019-12-16 13:52:41 +01:00
thomwolf	56e98ba81a	add model cards cc @mfuntowicz	2019-12-16 11:07:27 +01:00
thomwolf	8669598abd	update t5 tf	2019-12-16 09:59:36 +01:00
thomwolf	1b8613acb3	updating t5 config class	2019-12-16 09:51:42 +01:00
Morgan Funtowicz	8e3b1c860f	Added FeatureExtraction pipeline.	2019-12-15 01:37:52 +01:00
Morgan Funtowicz	f1971bf303	Binding pipelines to the cli.	2019-12-15 01:37:16 +01:00
Pascal Voitot	cc0135134b	:zip: #2106 basic tokenizer.tokenize global speed improvement (3-8x) by simply caching added_tokens in a Set	2019-12-14 15:25:13 +01:00
thomwolf	dc667ce1a7	double check cc @LysandreJik	2019-12-14 09:56:27 +01:00
thomwolf	7140363e09	update bertabs	2019-12-14 09:44:53 +01:00
Thomas Wolf	a52d56c8d9	Merge branch 'master' into cleanup-configs	2019-12-14 09:43:07 +01:00
Thomas Wolf	e92bcb7eb6	Merge pull request #1739 from huggingface/t5 ... [WIP] Adding Google T5 model	2019-12-14 09:40:43 +01:00
thomwolf	cbb368ca06	distilbert tests	2019-12-14 09:31:18 +01:00
Julien Chaumond	b6d4284b26	[cli] Uploads: fix + test edge case	2019-12-13 22:44:57 -05:00
erenup	a1faaf9962	deleted useless file	2019-12-14 08:57:13 +08:00
erenup	c7780700f5	Merge branch 'refs/heads/squad_roberta' ... # Conflicts: # transformers/data/processors/squad.py	2019-12-14 08:53:59 +08:00
erenup	76f0d99f02	Merge remote-tracking branch 'refs/remotes/huggingface/master'	2019-12-14 08:45:17 +08:00
erenup	8e9526b4b5	add multiple processing	2019-12-14 08:43:58 +08:00
Lysandre	7bd11dda6f	Release: v2.2.2	2019-12-13 16:45:30 -05:00
LysandreJik	c3248cf122	Tests for all tokenizers	2019-12-13 16:41:44 -05:00
Pascal Voitot	f2ac50cb55	better for python2.x	2019-12-13 16:41:44 -05:00
Pascal Voitot	4cbdc7d910	missed space	2019-12-13 16:41:44 -05:00
Pascal Voitot	dd2add9f6e	more tests	2019-12-13 16:41:44 -05:00
Pascal Voitot	df160af736	🐛 #2096 in tokenizer.decode, space is not joined between all subtexts instead of before added tokens	2019-12-13 16:41:44 -05:00
Pascal Voitot	5b7b78e088	🐛 #2096 in tokenizer.decode, adds a space after special tokens to return right formatted string	2019-12-13 16:41:44 -05:00
Julien Chaumond	866d73ca26	[cli] Upload is now compatible with folders	2019-12-13 16:39:08 -05:00
Lysandre	d461472948	return for SQuAD [BLACKED]	2019-12-13 15:31:52 -05:00
Lysandre	f24a228a93	Speed up tokenization process	2019-12-13 14:50:35 -05:00
Lysandre	c8ed1c82c8	[SQUAD] Load checkpoint when evaluating without training	2019-12-13 12:13:48 -05:00
thomwolf	5c00e344c1	update model doc - swith 3B/11B to 3b/11b	2019-12-13 16:33:29 +01:00
Morgan Funtowicz	0b51532ce9	Reintroducing the batch_encode_plus method	2019-12-13 16:22:50 +01:00
Thomas Wolf	110394b2ba	Merge branch 'master' into t5	2019-12-13 16:03:32 +01:00
Pierric Cistac	5a5c4349e8	Fix summarization to_cpu doc	2019-12-13 10:02:33 -05:00
thomwolf	8ade204098	fix tf	2019-12-13 14:48:47 +01:00
thomwolf	47f0e3cfb7	cleaning up configuration classes	2019-12-13 14:33:24 +01:00
Morgan Funtowicz	8938b546bf	Removed from_config	2019-12-13 14:27:04 +01:00
Morgan Funtowicz	1ca52567a4	Allow model conversion in the pipeline allocator.	2019-12-13 14:13:14 +01:00
Morgan Funtowicz	28e64ad5a4	Raise an exception if the pipeline allocator can't determine the tokenizer from the model.	2019-12-13 14:12:54 +01:00
Morgan Funtowicz	be5bf7b81b	Added NER pipeline.	2019-12-13 14:12:17 +01:00
Morgan Funtowicz	80eacb8f16	Adding labels mapping for classification models in their respective config.	2019-12-13 14:10:22 +01:00