Thomas Bauwens 8f137b2427 Move DataCollatorForMultipleChoice from the docs to the package (#34763) ... * Add implementation for DataCollatorForMultipleChoice based on docs. * Add DataCollatorForMultipleChoice to import structure. * Remove custom DataCollatorForMultipleChoice implementations from example scripts. * Remove custom implementations of DataCollatorForMultipleChoice from docs in English, Spanish, Japanese and Korean. * Refactor torch version of DataCollatorForMultipleChoice to be more easily understandable. * Apply suggested changes and run make fixup. * fix copies, style and fixup * add missing documentation * nits * fix docstring * style * nits * isort --------- Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com> Co-authored-by: Arthur Zucker <arthur.zucker@gmail.com>		2025-02-13 12:01:28 +01:00
..
__init__.py	[Test refactor 1/5] Per-folder tests reorganization (#15725)	2022-02-23 15:46:28 -05:00
test_data_collator.py	Enhance DataCollatorForLanguageModeling with Configurable Token Replacement Probabilities (#35251)	2025-01-14 17:01:10 +00:00
test_trainer_callback.py	add a callback hook right before the optimizer step (#33444)	2024-09-13 10:43:45 +02:00
test_trainer_distributed_loss.py	Fix multi gpu loss sync condition, add doc and test (#35743)	2025-02-12 15:41:31 +01:00
test_trainer_distributed.py	CI: update to ROCm 6.0.2 and test MI300 (#30266)	2024-05-13 18:14:36 +02:00
test_trainer_fsdp.py	Remove FSDP wrapping from sub-models. (#34452)	2024-11-15 23:00:03 +01:00
test_trainer_seq2seq.py	Trainer - deprecate tokenizer for processing_class (#32385)	2024-10-02 14:08:46 +01:00
test_trainer_tpu.py	[Test refactor 1/5] Per-folder tests reorganization (#15725)	2022-02-23 15:46:28 -05:00
test_trainer_utils.py	layernorm_decay_fix (#35927)	2025-02-04 11:01:49 +01:00
test_trainer.py	Move DataCollatorForMultipleChoice from the docs to the package (#34763)	2025-02-13 12:01:28 +01:00