riaz.somc/transformers
1
0
Fork 0
mirror of https://github.com/huggingface/transformers.git synced 2025-07-04 05:10:06 +06:00
Code Issues Actions 20 Packages Projects Releases Wiki Activity

when delaying optimizer creation only prepare the model

Browse Source
This commit is contained in:
Wing Lian 2025-07-01 10:30:18 -04:00
parent 1283877571
commit b0150b0abe
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
src/transformers/trainer.py
View File

@ -2357,7 +2357,7 @@ class Trainer:
model = self.accelerator.prepare(self.model) model = self.accelerator.prepare(self.model)
else: else:
if delay_optimizer_creation: if delay_optimizer_creation:
self.optimizer = self.accelerator.prepare(self.optimizer) model = self.accelerator.prepare(self.model)
else: else:
model, self.optimizer = self.accelerator.prepare(self.model, self.optimizer) model, self.optimizer = self.accelerator.prepare(self.model, self.optimizer)
else: else: