riaz.somc/transformers
1
0
Fork 0
mirror of https://github.com/huggingface/transformers.git synced 2025-08-01 02:31:11 +06:00
Code Issues Actions 3 Packages Projects Releases Wiki Activity

Update src/transformers/quantizers/quantizer_compressed_tensors.py

Browse Source 
Co-authored-by: Kyle Sayers <kylesayrs@gmail.com>
This commit is contained in:
shanjiaz 2025-06-25 14:37:25 -04:00 committed by GitHub
parent 58bae8dd36
commit 8d9de7af15
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
src/transformers/quantizers/quantizer_compressed_tensors.py
View File

@ -134,7 +134,7 @@ class CompressedTensorsHfQuantizer(HfQuantizer):
quant_targets.update(group.targets) quant_targets.update(group.targets)
# Disable gradient computation for quantized int modules # Disable gradient computation for quantized int modules
for _, module in model.named_modules(): for module in model.modules():
if type(module).__name__ in quant_targets: if type(module).__name__ in quant_targets:
for param in module.parameters(): for param in module.parameters():
param.requires_grad = False param.requires_grad = False