riaz.somc/transformers
1
0
Fork 0
mirror of https://github.com/huggingface/transformers.git synced 2025-07-31 02:02:21 +06:00
Code Issues Actions 23 Packages Projects Releases Wiki Activity

set model to training mode before accelerate.prepare (#24520)

Browse Source
This commit is contained in:
Wang, Yi 2023-06-27 22:09:38 +08:00 committed by GitHub
parent 06910f5a76
commit 4e8929dcbb
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
src/transformers/trainer.py
View File

@ -1640,6 +1640,7 @@ class Trainer:
# prepare using `accelerator` prepare
if use_accelerator_prepare:
self.model.train()
if hasattr(self.lr_scheduler, "step"):
if self.use_apex:
model = self.accelerator.prepare(self.model)