riaz.somc/transformers
1
0
Fork 0
mirror of https://github.com/huggingface/transformers.git synced 2025-07-31 02:02:21 +06:00
Code Issues Actions 23 Packages Projects Releases Wiki Activity

Avoid using no_sync on SageMaker DP (#11229)

Browse Source
This commit is contained in:
Sylvain Gugger 2021-04-13 15:34:00 -04:00 committed by GitHub
parent 9fa2995993
commit 9d8e8a8703
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
src/transformers/training_args.py
View File

@ -805,7 +805,7 @@ class TrainingArguments:
"""
Whether or not to use no_sync for the gradients when doing gradient accumulation.
"""
return not (self.deepspeed or is_sagemaker_mp_enabled())
return not (self.deepspeed or is_sagemaker_dp_enabled() or is_sagemaker_mp_enabled())
def to_dict(self):
"""