13 Commits

Author	SHA1	Message	Date
Zachary Mueller	febe42b5da	Update no_trainer scripts with new Accelerate functionalities (#16617) ... Adds logging and save/loading to the Accelerate scripts Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>	2022-04-06 15:29:32 -04:00
Sylvain Gugger	4975002df5	Reorganize file utils (#16264) ... * Split file_utils in several submodules * Fixes * Add back more objects * More fixes * Who exactly decided to import that from there? * Second suggestion to code with code review * Revert wront move * Fix imports * Adapt all imports * Adapt all imports everywhere * Revert this import, will fix in a separate commit	2022-03-23 10:26:33 -04:00
Sylvain Gugger	c98a6ac211	Use argument for preprocessing workers in run_summairzation (#15394)	2022-01-28 18:34:10 -05:00
Sylvain Gugger	08a5f57567	Add new LFS prune API (#14294)	2021-11-05 18:58:51 -04:00
Weizhe Yuan	7a3147e9b8	fix typo (#14049)	2021-10-18 18:03:11 -04:00
Patrick von Platen	44eb8bdeea	map only on one process (#13810)	2021-09-30 18:52:53 +02:00
Sylvain Gugger	b7d264be0d	Add push_to_hub to no_trainer examples (#13659) ... * Add push_to_hub to no_trainer examples * Quality * Document integration * Roll out to other examples	2021-09-21 13:13:30 -04:00
Allan Lin	91ff480e26	Update namespaces inside torch.utils.data to the latest. (#13167) ... * Update torch.utils.data namespaces to the latest. * Format * Update Dataloader. * Style	2021-08-19 14:29:51 +02:00
Stas Bekman	4a872caef4	remove extra white space from log format (#12360)	2021-06-25 13:20:14 -07:00
Bhavitvya Malik	e43e11260f	update desc for map in all examples (#12226) ... * update desc for map in all examples * added plm * suggestions	2021-06-17 15:37:31 -04:00
Tomy Hsieh	eb3e072a3b	Fix a small error in summarization example (#11762)	2021-05-18 14:38:36 -04:00
Jonathan Chang	64232bc0df	Add --text_column to run_summarization_no_trainer (#11673)	2021-05-11 07:58:38 -04:00
Sylvain Gugger	dabeb15292	Examples reorg (#11350) ... * Base move * Examples reorganization * Update references * Put back test data * Move conftest * More fixes * Move test data to test fixtures * Update path * Apply suggestions from code review Co-authored-by: Lysandre Debut <lysandre@huggingface.co> * Address review comments and clean Co-authored-by: Lysandre Debut <lysandre@huggingface.co>	2021-04-21 11:11:20 -04:00