Sourab Mangrulkar a73b1d59a3 accelerate deepspeed and gradient accumulation integrate (#23236) ... * mixed precision support via accelerate * fix issues * fix for the sharded ddp case * fix flax and tf failing tests * `refactor the place to create `Accelerator` object * move ddp prep to accelerate * fix 😅 * resolving comments * move fsdp handling to accelerate * fixex * fix saving * shift torch dynamo handling to accelerate * shift deepspeed integration and save & load utils to accelerate * fix accelerate launcher support * oops * fix 🐛 * save ckpt fix * Trigger CI * nasty 🐛 😅 * as deepspeed needs grad_acc fixes, transfer grad_acc to accelerate * make tests happy * quality ✨ * loss tracked needs to account for grad_acc * fixing the deepspeed tests * quality ✨ * 😅😅😅 * tests 😡 * quality ✨ * Trigger CI * resolve comments and fix the issue with the previous merge from branch * Trigger CI * accelerate took over deepspeed integration --------- Co-authored-by: Stas Bekman <stas@stason.org>		2023-05-31 15:16:22 +05:30
..
ds_config_zero2.json	[Deepspeed] add support for bf16 mode (#14569)	2022-03-11 17:53:53 -08:00
ds_config_zero3.json	[Deepspeed] add support for bf16 mode (#14569)	2022-03-11 17:53:53 -08:00
test_deepspeed.py	accelerate deepspeed and gradient accumulation integrate (#23236)	2023-05-31 15:16:22 +05:30
test_model_zoo.py	Apply ruff flake8-comprehensions (#21694)	2023-02-22 09:14:54 +01:00
vit_feature_extractor.json	missing file (#17164)	2022-05-10 10:19:50 -07:00