riaz.somc/transformers
1
0
Fork 0
mirror of https://github.com/huggingface/transformers.git synced 2025-07-03 12:50:06 +06:00
Code Issues Actions 28 Packages Projects Releases Wiki Activity

Fixing name 'torch' is not defined in bitsandbytes integration (#31243)

Browse Source 
Fixed torch definition error
This commit is contained in:
James Braza 2024-06-04 23:00:30 -07:00 committed by GitHub
parent 66875ac070
commit 63fb253df0
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
src/transformers/integrations/bitsandbytes.py
View File

@ -332,7 +332,7 @@ def get_keys_to_not_convert(model):
# Copied from PEFT: https://github.com/huggingface/peft/blob/47b3712898539569c02ec5b3ed4a6c36811331a1/src/peft/utils/integrations.py#L41
def dequantize_bnb_weight(weight: torch.nn.Parameter, state=None):
def dequantize_bnb_weight(weight: "torch.nn.Parameter", state=None):
"""
Helper function to dequantize 4bit or 8bit bnb weights.