riaz.somc/transformers
1
0
Fork 0
mirror of https://github.com/huggingface/transformers.git synced 2025-07-23 22:38:58 +06:00
Code Issues Actions 31 Packages Projects Releases Wiki Activity

remove potential UndefinedError

Browse Source
This commit is contained in:
Rémi Louf 2019-10-17 17:52:32 +02:00
parent b915ba9dfe
commit cb26b035c6
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
transformers/modeling_xlm.py
View File

@ -81,8 +81,8 @@ def get_masks(slen, lengths, causal, padding_mask=None):
mask = alen < lengths[:, None]
# attention mask is the same as mask, or triangular inferior attention (causal)
bs = lengths.size(0)
if causal:
bs = lengths.size(0)
attn_mask = alen[None, None, :].repeat(bs, slen, 1) <= alen[None, :, None]
else:
attn_mask = mask