8 Commits

Author	SHA1	Message	Date
Pavel Iakubovskii	c15aad0939	Add strategy to store results in evaluation loop (#30267) ... * Add evaluation loop container for interm. results * Add tests for EvalLoopContainer * Formatting * Fix padding_index in test and typo * Move EvalLoopContainer to pr_utils to avoid additional imports * Fix `eval_do_concat_batches` arg description * Fix EvalLoopContainer import	2024-04-17 12:42:27 +01:00
Aaron Gokaslan	5e8c8eb5ba	Apply ruff flake8-comprehensions (#21694)	2023-02-22 09:14:54 +01:00
Antoni Baum	47412c7d43	Ensure tensors are at least 1d for pad and concat (#17179) ... * Ensure tensors are at least 1d for pad and concat * Compatibility * Fix * Fix * Add test * Retrigger CI * Consistency with master * Retrigger CI	2022-05-11 13:19:08 -04:00
Antoni Baum	edcc66d27c	Remove unnecessary columns for all dataset types in Trainer (#17166) ... * Remove unneeded columns for IterableDataset * Add test * Update trainer tests * Edit docstring * Lint * Apply feedback * Apply feedback	2022-05-11 11:11:26 -04:00
Zachary Mueller	2fbb237967	Add the auto_find_batch_size capability from Accelerate into Trainer (#17068) ... Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com> - Adds auto_batch_size finder - Moves training loop to an inner training loop	2022-05-09 12:29:18 -04:00
code-review-doctor	a2392415e9	Some tests misusing assertTrue for comparisons fix (#16771) ... * Fix issue avoid-misusing-assert-true found at https://codereview.doctor * fix tests * fix tf Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>	2022-04-19 14:44:08 +02:00
Sylvain Gugger	4975002df5	Reorganize file utils (#16264) ... * Split file_utils in several submodules * Fixes * Add back more objects * More fixes * Who exactly decided to import that from there? * Second suggestion to code with code review * Revert wront move * Fix imports * Adapt all imports * Adapt all imports everywhere * Revert this import, will fix in a separate commit	2022-03-23 10:26:33 -04:00
Lysandre Debut	29c10a41d0	[Test refactor 1/5] Per-folder tests reorganization (#15725) ... * Per-folder tests reorganization Co-authored-by: sgugger <sylvain.gugger@gmail.com> Co-authored-by: Stas Bekman <stas@stason.org>	2022-02-23 15:46:28 -05:00