Allow Trainer.get_optimizer_cls_and_kwargs to be overridden (#31875)

* Change `Trainer.get_optimizer_cls_and_kwargs` to `self.`

* Make `get_optimizer_cls_and_kwargs` an instance method

* Fixing typo

* Revert `get_optimizer_cls_and_kwargs` to staticmethod

* restore newline to trainer.py eof
This commit is contained in:
Apoorv Khandelwal 2024-07-11 17:13:06 -04:00 committed by GitHub
parent 52585019a1
commit 574e68d554
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194

View File

@ -1079,7 +1079,7 @@ class Trainer:
}, },
] ]
optimizer_cls, optimizer_kwargs = Trainer.get_optimizer_cls_and_kwargs(self.args, opt_model) optimizer_cls, optimizer_kwargs = self.get_optimizer_cls_and_kwargs(self.args, opt_model)
# Overwrite `params` in case it's created by `get_optimizer_cls_and_kwargs` # Overwrite `params` in case it's created by `get_optimizer_cls_and_kwargs`
# e.g. for GaLore optimizer. # e.g. for GaLore optimizer.