riaz.somc/transformers
1
0
Fork 0
mirror of https://github.com/huggingface/transformers.git synced 2025-08-03 03:31:05 +06:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity

[CLIP] fix grad ckpt (#15789)

Browse Source
This commit is contained in:
Suraj Patil 2022-02-23 14:30:05 +01:00 committed by GitHub
parent a3e607d19e
commit de737866f2
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
src/transformers/models/clip/modeling_clip.py
View File

@ -572,7 +572,7 @@ class CLIPEncoder(nn.Module):
output_attentions=output_attentions, output_attentions=output_attentions,
) )
hidden_states = layer_outputs[0] hidden_states = layer_outputs[0]
if output_attentions: if output_attentions:
all_attentions = all_attentions + (layer_outputs[1],) all_attentions = all_attentions + (layer_outputs[1],)