riaz.somc/transformers
1
0
Fork 0
mirror of https://github.com/huggingface/transformers.git synced 2025-08-02 19:21:31 +06:00
Code Issues Actions 3 Packages Projects Releases Wiki Activity

🚨🚨🚨 Use default ignore index in Luke (#23014)

Browse Source 
Use default ignore index in Luke
This commit is contained in:
Sylvain Gugger 2023-04-26 17:55:01 -04:00 committed by GitHub
parent 8b129030cb
commit 0083b149e9
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
src/transformers/models/luke/modeling_luke.py
View File

@ -1298,7 +1298,7 @@ class LukeForMaskedLM(LukePreTrainedModel):
self.lm_head = LukeLMHead(config)
self.entity_predictions = EntityPredictionHead(config)
self.loss_fn = nn.CrossEntropyLoss(ignore_index=-1)
self.loss_fn = nn.CrossEntropyLoss()
# Initialize weights and apply final processing
self.post_init()