riaz.somc/transformers
1
0
Fork 0
mirror of https://github.com/huggingface/transformers.git synced 2025-07-03 12:50:06 +06:00
Code Issues Actions 28 Packages Projects Releases Wiki Activity

when delaying optimizer creation only prepare the model

Browse Source
This commit is contained in:
Wing Lian 2025-07-01 10:30:18 -04:00
parent 1283877571
commit b0150b0abe
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
src/transformers/trainer.py
View File

@ -2357,7 +2357,7 @@ class Trainer:
model = self.accelerator.prepare(self.model)
else:
if delay_optimizer_creation:
self.optimizer = self.accelerator.prepare(self.optimizer)
model = self.accelerator.prepare(self.model)
else:
model, self.optimizer = self.accelerator.prepare(self.model, self.optimizer)
else: