transformers/tests/trainer
yutong_liu 8b479e39bb
Saving Trainer.collator.tokenizer in when Trainer.processing_class is None (#36552)
* feat: Saving tokenizer in collator when processing_class is None

* chore: Style issue

* chore: Typo

* dbg: Check why test failed

* dbg: Remove logics and another test failed which successed before, so should be the stablibility issue

* test: Init unit-test

* chore: Style

* chore: Add err log

* fix: Case

* Update tests/trainer/test_trainer.py

Co-authored-by: Marc Sun <57196510+SunMarc@users.noreply.github.com>

* chore: Try to use get_regression_trainer

* fix: Impl and style

* fix: Style

* fix: Case

* fix: Import err

* fix: Missed import

* fix: Import block un-sorted problem

* fix: Try another tokenizer

* fix: Test logic

* chore: Light updates

* chore: Reformat

---------

Co-authored-by: Marc Sun <57196510+SunMarc@users.noreply.github.com>
2025-03-20 11:27:47 +01:00
..
__init__.py [Test refactor 1/5] Per-folder tests reorganization (#15725) 2022-02-23 15:46:28 -05:00
test_data_collator.py Fixed datatype related issues in DataCollatorForLanguageModeling (#36457) 2025-03-07 14:09:27 +00:00
test_trainer_callback.py fix: prevent second save in the end of training if last step was saved already (#36219) 2025-02-20 17:38:52 +01:00
test_trainer_distributed_loss.py Fix multi gpu loss sync condition, add doc and test (#35743) 2025-02-12 15:41:31 +01:00
test_trainer_distributed.py HPU support (#36424) 2025-03-12 09:08:12 +01:00
test_trainer_fsdp.py HPU support (#36424) 2025-03-12 09:08:12 +01:00
test_trainer_seq2seq.py fix typos in the tests directory (#36717) 2025-03-17 17:45:57 +00:00
test_trainer_tpu.py [Test refactor 1/5] Per-folder tests reorganization (#15725) 2022-02-23 15:46:28 -05:00
test_trainer_utils.py layernorm_decay_fix (#35927) 2025-02-04 11:01:49 +01:00
test_trainer.py Saving Trainer.collator.tokenizer in when Trainer.processing_class is None (#36552) 2025-03-20 11:27:47 +01:00