Stas Bekman
73fdc8c5b4
[deepspeed zero3] need generate(synced_gpus=True, ...) ( #22242 )
...
* [deepspeed zero3] need generate(synced_gpus=True, ...)
* fix
* rework per Sylvain's suggestion
* Apply suggestions from code review
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
---------
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
2023-03-22 12:18:57 -07:00
Stas Bekman
89a0a9eace
[deepspeed] offload + non-cpuadam optimizer exception doc ( #22044 )
...
* [deepspeed] offload + non-cpuadam optimizer exception doc
* deps
2023-03-21 17:00:05 -07:00
Stas Bekman
618697ef53
[deepspeed docs] Activation Checkpointing ( #22099 )
...
* [deepspeed docs] Activation Checkpointing
* Apply suggestions from code review
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
* Update deepspeed.mdx
---------
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
2023-03-13 12:52:42 -07:00
Stas Bekman
3eba1dd27e
[doc] deepspeed tests ( #21859 )
2023-03-01 08:52:49 -08:00
Thomas Paviot
ba2a5f13f7
Fix en documentation typos ( #21799 )
...
* fix wrong url
* typos in english documentation
2023-02-27 08:36:36 +01:00
Stas Bekman
101b9a7eb1
[deepspeed] performance docs ( #21573 )
...
* [deepspeed] performance docs
* fix
* re-org
* update
* update
* a new NCCL Collectives section
* inference
* Update docs/source/en/main_classes/deepspeed.mdx
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
* suggestion
* Update docs/source/en/main_classes/deepspeed.mdx
* suggestion
---------
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
2023-02-13 10:29:12 -08:00
Eugene Zapolsky
129011c20b
adding a tip for deepspeed integration in multi-node environment ( #21459 )
...
* adding note concerning use_node_local_storage
* overriding checkpoint.use_node_local_storage if save_on_each_node == True
* add more content
* add more content
* improve
* style
---------
Co-authored-by: Stas Bekman <stas@stason.org>
2023-02-10 09:12:56 -05:00
Tom Aarsen
3222fc645b
docs: Resolve many typos in the English docs ( #20088 )
...
* docs: Fix typo in ONNX parser help: 'tolerence' => 'tolerance'
* docs: Resolve many typos in the English docs
Typos found via 'codespell ./docs/source/en'
2022-11-07 09:19:04 -05:00
Hakjin Lee
abca1741cf
Fix a broken link for deepspeed ZeRO inference in the docs ( #19001 )
...
* Fix a broken link for deepspeed ZeRO inference
* fix link
Co-authored-by: Stas Bekman <stas@stason.org>
2022-09-14 16:21:06 -07:00
Philipp Schmid
f2fbe44753
Fix broken link DeepSpeed documentation link ( #18783 )
...
* Fix broken link
* Trigger CI
Co-authored-by: Stas Bekman <stas@stason.org>
2022-08-28 19:32:19 -07:00
Sylvain Gugger
b9a768b3ff
Enable doc in Spanish ( #16518 )
...
* Reorganize doc for multilingual support
* Fix style
* Style
* Toc trees
* Adapt templates
2022-04-04 10:25:46 -04:00
