riaz.somc/transformers
1
0
Fork 0
mirror of https://github.com/huggingface/transformers.git synced 2025-07-31 02:02:21 +06:00
Code Issues Actions 23 Packages Projects Releases Wiki Activity

[XGLM] Add accelerate support for XGLM (#22207)

Browse Source 
* add `accelerate` support for XGLM

* fix order
This commit is contained in:
Younes Belkada 2023-03-16 16:18:05 +01:00 committed by GitHub
parent a88a4dae19
commit da3ba3a167
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
src/transformers/models/xglm/modeling_xglm.py
View File

@ -510,6 +510,7 @@ class XGLMPreTrainedModel(PreTrainedModel):
config_class = XGLMConfig
base_model_prefix = "model"
supports_gradient_checkpointing = True
_no_split_modules = ["XGLMDecoderLayer"]
def _init_weights(self, module):
std = self.config.init_std