15 Commits

Author	SHA1	Message	Date
Julien Chaumond	dd9d483d03	Trainer (#3800) ... * doc * [tests] Add sample files for a regression task * [HUGE] Trainer * Feedback from @sshleifer * Feedback from @thomwolf + logging tweak * [file_utils] when downloading concurrently, get_from_cache will use the cached file for subsequent processes * [glue] Use default max_seq_length of 128 like before * [glue] move DataTrainingArguments around * [ner] Change interface of InputExample, and align run_{tf,pl} * Re-align the pl scripts a little bit * ner * [ner] Add integration test * Fix language_modeling with API tweak * [ci] Tweak loss target * Don't break console output * amp.initialize: model must be on right device before * [multiple-choice] update for Trainer * Re-align to 827d6d6ef0	2020-04-21 20:11:56 -04:00
Andrey Kulagin	b1ff0b2ae7	Fix bug in examples: double wrap into DataParallel during eval	2020-04-20 19:37:44 -04:00
Julien Chaumond	50e15c825c	Tokenizers: Start cleaning examples a little (#3455) ... * Start cleaning examples * Fixup	2020-04-01 07:13:40 -04:00
Julien Chaumond	a8e3336a85	[examples] Use AutoModels in more examples	2020-03-23 20:11:14 -04:00
Elijah Rippeth	634bf6cf7e	fixes lr_scheduler warning ... For more details, see https://pytorch.org/docs/stable/optim.html#how-to-adjust-learning-rate	2020-03-20 18:03:50 -04:00
Julien Chaumond	656e1386a2	Fix #3305: run_ner only possible on ModelForTokenClassification models	2020-03-19 16:41:28 -04:00
J.P Lee	2b60a26b46	Update examples/ner/run_ner.py to use AutoModel (#3305) ... * Update examples/ner/run_ner.py to use AutoModel * Fix missing code and apply `make style` command	2020-03-17 12:30:10 -04:00
Victor SANH	6b1ff25084	fix n_gpu count when no_cuda flag is activated (#3077) ... * fix n_gpu count when no_cuda flag is activated * someone was left behind	2020-03-02 10:20:21 -05:00
Martin Malmsten	d762d4289c	Code now passes style enforcement	2020-02-26 23:50:40 +01:00
Martin Malmsten	9495d38b0d	Changes from reviews.	2020-02-26 23:36:39 +01:00
Martin Malmsten	105dcb4162	Now passes style guide enforcement	2020-02-23 21:47:59 +01:00
Martin Malmsten	33eb8a165d	Added ,	2020-02-23 21:43:31 +01:00
Martin Malmsten	869b66f6b3	* Added support for Albert when fine-tuning for NER ... * Added support for Albert in NER pipeline * Added command-line options to examples/ner/run_ner.py to better control tokenization * Added class AlbertForTokenClassification * Changed output for NerPipeline to use .convert_ids_to_tokens(...) instead of .decode(...) to better reflect tokens	2020-02-23 21:13:03 +01:00
Martin Malmsten	4452b44b90	Labels are now added to model config under id2label and label2id (#2945)	2020-02-21 08:53:05 -05:00
srush	b662f0e625	Support for torch-lightning in NER examples (#2890) ... * initial pytorch lightning commit * tested multigpu * Fix learning rate schedule * black formatting * fix flake8 * isort * isort * . Co-authored-by: Check your git settings! <chris@chris-laptop>	2020-02-20 11:50:05 -05:00