riaz.somc/transformers
1
0
Fork 0
mirror of https://github.com/huggingface/transformers.git synced 2025-07-30 17:52:35 +06:00
Code Issues Actions 30 Packages Projects Releases Wiki Activity

Fix the bug in constructing the all_hidden_states of DeBERTa v2 (#10466)

Browse Source 
* fix all_hidden_states

* use output_states instead of next_kv
This commit is contained in:
felixgwu 2021-03-03 12:05:21 -05:00 committed by GitHub
parent 188574ac50
commit d064fb5647
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 2 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
src/transformers/models/deberta_v2/modeling_deberta_v2.py
View File

@ -450,10 +450,11 @@ class DebertaV2Encoder(nn.Module):
else:
next_kv = hidden_states
rel_embeddings = self.get_rel_embedding()
output_states = next_kv
for i, layer_module in enumerate(self.layer):
if output_hidden_states:
all_hidden_states = all_hidden_states + (hidden_states,)
all_hidden_states = all_hidden_states + (output_states,)
output_states = layer_module(
next_kv,