riaz.somc/transformers
1
0
Fork 0
mirror of https://github.com/huggingface/transformers.git synced 2025-07-03 12:50:06 +06:00
Code Issues Actions 28 Packages Projects Releases Wiki Activity

Fix attention mask expansion when converting to executorch (#38637)

Browse Source
This commit is contained in:
pweglik 2025-06-09 17:00:55 +02:00 committed by GitHub
parent 19224c3642
commit 282d6684dc
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
src/transformers/modeling_attn_mask_utils.py
View File

@ -193,7 +193,7 @@ class AttentionMaskConverter:
expanded_mask = mask[:, None, None, :].expand(bsz, 1, tgt_len, src_len).to(dtype)
inverted_mask = 1.0 - expanded_mask
inverted_mask = torch.tensor(1.0, dtype=dtype) - expanded_mask
return inverted_mask.masked_fill(inverted_mask.to(torch.bool), torch.finfo(dtype).min)