riaz.somc/transformers
1
0
Fork 0
mirror of https://github.com/huggingface/transformers.git synced 2025-08-02 19:21:31 +06:00
Code Issues Actions 3 Packages Projects Releases Wiki Activity

Fix XGLM cross attention (#16290)

Browse Source
This commit is contained in:
Suraj Patil 2022-03-21 13:07:28 +01:00 committed by GitHub
parent f393868073
commit 641e5f3f55
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
src/transformers/models/xglm/modeling_xglm.py
View File

@ -399,7 +399,7 @@ class XGLMDecoderLayer(nn.Module):
self.activation_dropout = config.activation_dropout
if config.add_cross_attention:
self.crossattention = XGLMAttention(
self.encoder_attn = XGLMAttention(
embed_dim=self.embed_dim,
num_heads=config.attention_heads,
dropout=config.attention_dropout,