Matthew Douglas 196d35ccfc Add AdEMAMix optimizer (#33682) ... * Add AdEMAMix optimizer * Fix test * Update tests/trainer/test_trainer.py Co-authored-by: Marc Sun <57196510+SunMarc@users.noreply.github.com> --------- Co-authored-by: Marc Sun <57196510+SunMarc@users.noreply.github.com>		2024-09-25 18:07:21 +01:00
..
__init__.py	[Test refactor 1/5] Per-folder tests reorganization (#15725)	2022-02-23 15:46:28 -05:00
test_data_collator.py	Enhancing SFT Training Efficiency Using Packing and FlashAttention2 with Position IDs (#31629)	2024-07-23 15:56:41 +02:00
test_trainer_callback.py	add a callback hook right before the optimizer step (#33444)	2024-09-13 10:43:45 +02:00
test_trainer_distributed.py	CI: update to ROCm 6.0.2 and test MI300 (#30266)	2024-05-13 18:14:36 +02:00
test_trainer_seq2seq.py	Pass datasets trust_remote_code (#31406)	2024-06-17 17:29:13 +01:00
test_trainer_tpu.py	[Test refactor 1/5] Per-folder tests reorganization (#15725)	2022-02-23 15:46:28 -05:00
test_trainer_utils.py	Add strategy to store results in evaluation loop (#30267)	2024-04-17 12:42:27 +01:00
test_trainer.py	Add AdEMAMix optimizer (#33682)	2024-09-25 18:07:21 +01:00