riaz.somc/transformers
1
0
Fork 0
mirror of https://github.com/huggingface/transformers.git synced 2025-07-31 02:02:21 +06:00
Code Issues Actions 33 Packages Projects Releases Wiki Activity

Removed unused fields in DistilBert TransformerBlock (#2710)

Browse Source 
* Removed unused fields in DistilBert TransformerBlock
This commit is contained in:
guillaume-be 2020-02-20 22:08:21 +01:00 committed by GitHub
parent 889d3bfdbb
commit 564fd75d65
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 0 additions and 5 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

5
src/transformers/modeling_distilbert.py
View File

@ -217,11 +217,6 @@ class TransformerBlock(nn.Module):
def __init__(self, config):
super().__init__()
self.n_heads = config.n_heads
self.dim = config.dim
self.hidden_dim = config.hidden_dim
self.dropout = nn.Dropout(p=config.dropout)
self.activation = config.activation
self.output_attentions = config.output_attentions
assert config.dim % config.n_heads == 0