riaz.somc/transformers
1
0
Fork 0
mirror of https://github.com/huggingface/transformers.git synced 2025-07-31 02:02:21 +06:00
Code Issues Actions 33 Packages Projects Releases Wiki Activity

Pass use_cache in kwargs for GPTNeoX (#30538)

Browse Source 
pass use_cache in kwargs
This commit is contained in:
Raushan Turganbay 2024-04-30 12:16:18 +05:00 committed by GitHub
parent a3aabc702e
commit c712d05aa8
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
src/transformers/models/gpt_neox/modeling_gpt_neox.py
View File

@ -1108,6 +1108,7 @@ class GPTNeoXForCausalLM(GPTNeoXPreTrainedModel):
"attention_mask": attention_mask,
"past_key_values": past_key_values,
"position_ids": position_ids,
"use_cache": kwargs.get("use_cache"),
}
)