transformers/examples/tests/trainer
Sylvain Gugger 9d14be5c20
Add support for ZeRO-2/3 and ZeRO-offload in fairscale (#10354)
* Ass support for ZeRO-2/3 and ZeRO-offload in fairscale

* Quality

* Rework from review comments

* Add doc

* Apply suggestions from code review

Co-authored-by: Stas Bekman <stas00@users.noreply.github.com>

* Address review comments

Co-authored-by: Stas Bekman <stas00@users.noreply.github.com>
2021-02-25 11:07:53 -05:00
..
test_trainer_ext.py Add support for ZeRO-2/3 and ZeRO-offload in fairscale (#10354) 2021-02-25 11:07:53 -05:00