riaz.somc/transformers
1
0
Fork 0
mirror of https://github.com/huggingface/transformers.git synced 2025-07-31 02:02:21 +06:00
Code Issues Actions 23 Packages Projects Releases Wiki Activity
bc2571e61c
transformers/tests/deepspeed
History
Stas Bekman bc2571e61c
[Deepspeed] ZeRO-Infinity integration plus config revamp (#11418) 
* adding Z-inf

* revamp config process

* up version requirement

* wip

* massive rewrite

* cleanup

* cleanup

* Apply suggestions from code review

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* consistent json commas

* act on suggestions

* leave this feature for 0.3.16

* style

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
2021-04-26 10:40:32 -07:00
..
ds_config_zero2.json [Deepspeed] ZeRO-Infinity integration plus config revamp (#11418) 2021-04-26 10:40:32 -07:00
ds_config_zero3.json [Deepspeed] ZeRO-Infinity integration plus config revamp (#11418) 2021-04-26 10:40:32 -07:00
test_deepspeed.py [Deepspeed] ZeRO-Infinity integration plus config revamp (#11418) 2021-04-26 10:40:32 -07:00