riaz.somc/transformers
1
0
Fork 0
mirror of https://github.com/huggingface/transformers.git synced 2025-08-02 19:21:31 +06:00
Code Issues Actions 3 Packages Projects Releases Wiki Activity

[Blip2] Add int8 support for blip2-flan-t5-xxl (#21574)

Browse Source 
add int8 support
This commit is contained in:
Younes Belkada 2023-02-10 23:28:24 +01:00 committed by GitHub
parent b47a16743b
commit 75a208ef66
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
src/transformers/models/blip_2/modeling_blip_2.py
View File

@ -285,6 +285,7 @@ class Blip2PreTrainedModel(PreTrainedModel):
r"language_model.decoder.embed_tokens.weight",
]
_no_split_modules = ["Blip2Attention", "T5Block", "OPTDecoderLayer"]
_keep_in_fp32_modules = ["wo"]
def _init_weights(self, module):
"""Initialize the weights"""