transformers/tests/deepspeed
Sourab Mangrulkar 6bc517ccd4
deepspeed resume from ckpt fixes and adding support for deepspeed optimizer and HF scheduler (#25863)
* Add support for deepspeed optimizer and HF scheduler

* fix bug

* fix the import

* fix issue with deepspeed scheduler saving for hf optim + hf scheduler scenario

* fix loading of hf scheduler when loading deepspeed checkpoint

* fix import of `DeepSpeedSchedulerWrapper`

* add tests

* add the comment and skip the failing tests

* address comment
2023-09-05 22:31:20 +05:30
..
ds_config_zero2.json [Deepspeed] add support for bf16 mode (#14569) 2022-03-11 17:53:53 -08:00
ds_config_zero3.json [Deepspeed] add support for bf16 mode (#14569) 2022-03-11 17:53:53 -08:00
test_deepspeed.py deepspeed resume from ckpt fixes and adding support for deepspeed optimizer and HF scheduler (#25863) 2023-09-05 22:31:20 +05:30
test_model_zoo.py Apply ruff flake8-comprehensions (#21694) 2023-02-22 09:14:54 +01:00
vit_feature_extractor.json missing file (#17164) 2022-05-10 10:19:50 -07:00