riaz.somc/transformers
1
0
Fork 0
mirror of https://github.com/huggingface/transformers.git synced 2025-08-02 19:21:31 +06:00
Code Issues Actions 3 Packages Projects Releases Wiki Activity

Fix exception thrown using MishActivation (#19739)

Browse Source 
* Fix exception thrown using MishActivation

* Update activations.py
This commit is contained in:
Chino 2022-10-20 21:13:35 +08:00 committed by GitHub
parent 2dd1b8f0c5
commit baa00f65ae
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
src/transformers/activations.py
View File

@ -121,7 +121,7 @@ class MishActivation(nn.Module):
def __init__(self):
super().__init__()
if version.parse(version.parse(torch.__version__).base_version) < version.parse("1.9"):
if version.parse(torch.__version__) < version.parse("1.9.0"):
self.act = self._mish_python
else:
self.act = nn.functional.mish