riaz.somc/transformers
1
0
Fork 0
mirror of https://github.com/huggingface/transformers.git synced 2025-07-03 12:50:06 +06:00
Code Issues Actions 28 Packages Projects Releases Wiki Activity

[AWQ, CI] Bump AWQ version used in docker image (#34922)

Browse Source 
The old AWQ version is failing with the latest (unreleased)
transformers, giving the error:

> ImportError: cannot import name 'shard_checkpoint' from
'transformers.modeling_utils'

This has been resolved in awq v0.2.7:

https://github.com/casper-hansen/AutoAWQ/pull/644
This commit is contained in:
Benjamin Bossan 2024-11-25 16:49:57 +01:00 committed by GitHub
parent 4e6b19cd95
commit b13916c09d
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 2 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
docker/transformers-quantization-latest-gpu/Dockerfile
View File

@ -52,8 +52,8 @@ RUN python3 -m pip install --no-cache-dir hqq
RUN python3 -m pip install --no-cache-dir gguf RUN python3 -m pip install --no-cache-dir gguf
# Add autoawq for quantization testing # Add autoawq for quantization testing
# >=v0.2.3 needed for compatibility with torch 2.2.1 # >=v0.2.7 needed for compatibility with transformers > 4.46
RUN python3 -m pip install --no-cache-dir https://github.com/casper-hansen/AutoAWQ/releases/download/v0.2.3/autoawq-0.2.3+cu118-cp310-cp310-linux_x86_64.whl RUN python3 -m pip install --no-cache-dir https://github.com/casper-hansen/AutoAWQ/releases/download/v0.2.7.post2/autoawq-0.2.7.post2-py3-none-any.whl
# Add quanto for quantization testing # Add quanto for quantization testing
RUN python3 -m pip install --no-cache-dir optimum-quanto RUN python3 -m pip install --no-cache-dir optimum-quanto