riaz.somc/transformers
1
0
Fork 0
mirror of https://github.com/huggingface/transformers.git synced 2025-07-03 04:40:06 +06:00
Code Issues Actions 28 Packages Projects Releases Wiki Activity

Fix hqq issue (#38551)
Some checks are pending
Self-hosted runner (benchmark) / Benchmark (aws-g5-4xlarge-cache) (push) Waiting to run
Details
Build documentation / build (push) Waiting to run
Details
New model PR merged notification / Notify new model (push) Waiting to run
Details
Slow tests on important models (on Push - A10) / Get all modified files (push) Waiting to run
Details
Slow tests on important models (on Push - A10) / Slow & FA2 tests (push) Blocked by required conditions
Details
Self-hosted runner (push-caller) / Check if setup was changed (push) Waiting to run
Details
Self-hosted runner (push-caller) / build-docker-containers (push) Blocked by required conditions
Details
Self-hosted runner (push-caller) / Trigger Push CI (push) Blocked by required conditions
Details
Secret Leaks / trufflehog (push) Waiting to run
Details
Update Transformers metadata / build_and_package (push) Waiting to run
Details

Browse Source 
* bc

* style
This commit is contained in:
Marc Sun 2025-06-03 17:58:31 +02:00 committed by GitHub
parent 279000bb70
commit 0f41c41a46
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 6 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

7
src/transformers/quantizers/quantizer_hqq.py
View File

@ -135,7 +135,11 @@ class HqqHfQuantizer(HfQuantizer):
# Append new expected layers based on _ref_keys
_ref_keys = HQQLinear(
linear_layer=None, quant_config=None, compute_dtype=torch.float16, device="cpu"
linear_layer=None,
quant_config=None,
compute_dtype=torch.float16,
device="cpu",
del_orig=False,
).state_dict_keys() - {"bias"}
# Clean-up
@ -224,6 +228,7 @@ class HqqHfQuantizer(HfQuantizer):
quant_config=None,
compute_dtype=self.torch_dtype,
device=target_device,
del_orig=False,
)
hqq_layer.load_state_dict(module_state_dict)