7 Commits

Author	SHA1	Message	Date
Sylvain Gugger	6f1adc4334	Fix group_lengths for short datasets (#12558)	2021-07-08 07:23:41 -04:00
Souvic Chakraborty	1d6623c6a2	MLM training fails with no validation file(same as #12406 for pytorch now) (#12517) ... * Validation split percentage to be used for custom data files also Issue same as https://github.com/huggingface/transformers/issues/12406 fixed for pytorch branch run_mlm.py * Validation split added in the right place * Update run_clm.py * validation split added for custom files * Validation split added for custom files * Update run_plm.py * fixed validation split for custom files as input for pytorch examples in lm * Update run_clm_no_trainer.py * args modified	2021-07-07 09:05:44 -04:00
Stas Bekman	4a872caef4	remove extra white space from log format (#12360)	2021-06-25 13:20:14 -07:00
Bhavitvya Malik	e43e11260f	update desc for map in all examples (#12226) ... * update desc for map in all examples * added plm * suggestions	2021-06-17 15:37:31 -04:00
Stas Bekman	6287c929c1	[lm examples] fix overflow in perplexity calc (#11855) ... * fix overflow in perplexity calc * use inf * fix	2021-05-25 08:11:26 -07:00
Jonathan Chang	6f40e31766	Fix comment in run_clm_no_trainer.py (#11624)	2021-05-07 12:32:30 +05:30
Sylvain Gugger	dabeb15292	Examples reorg (#11350) ... * Base move * Examples reorganization * Update references * Put back test data * Move conftest * More fixes * Move test data to test fixtures * Update path * Apply suggestions from code review Co-authored-by: Lysandre Debut <lysandre@huggingface.co> * Address review comments and clean Co-authored-by: Lysandre Debut <lysandre@huggingface.co>	2021-04-21 11:11:20 -04:00