[CLIP] fix grad ckpt (#15789)

This commit is contained in:
Suraj Patil 2022-02-23 14:30:05 +01:00 committed by GitHub
parent a3e607d19e
commit de737866f2
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23

View File

@ -572,7 +572,7 @@ class CLIPEncoder(nn.Module):
output_attentions=output_attentions,
)
hidden_states = layer_outputs[0]
hidden_states = layer_outputs[0]
if output_attentions:
all_attentions = all_attentions + (layer_outputs[1],)