Younes Belkada ae093eef01 [core / Quantization ] AWQ integration (#27045) ... * working v1 * oops * Update src/transformers/modeling_utils.py Co-authored-by: Marc Sun <57196510+SunMarc@users.noreply.github.com> * fixup * oops * push * more changes * add docs * some fixes * fix copies * add v1 doc * added installation guide * relax constraints * revert * attempt llm-awq * oops * oops * fixup * raise error when incorrect cuda compute capability * nit * add instructions for llm-awq * fixup * fix copies * fixup and docs * change * few changes + add demo * add v1 tests * add autoawq in dockerfile * finalize * Update tests/quantization/autoawq/test_awq.py * fix test * fix * fix issue * Update src/transformers/integrations/awq.py Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com> * Update docs/source/en/main_classes/quantization.md Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com> * Update docs/source/en/main_classes/quantization.md Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com> * Update src/transformers/integrations/awq.py Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com> * Update src/transformers/integrations/awq.py Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com> * add link to example script * Update docs/source/en/main_classes/quantization.md Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com> * add more content * add more details * add link to quantization docs * camel case + change backend class name * change to string * fixup * raise errors if libs not installed * change to `bits` and `group_size` * nit * nit * Apply suggestions from code review Co-authored-by: Marc Sun <57196510+SunMarc@users.noreply.github.com> * disable training * address some comments and fix nits * fix * final nits and fix tests * adapt to our new runners * make fix-copies * Update src/transformers/utils/quantization_config.py Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com> * Update src/transformers/utils/quantization_config.py Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com> * Update src/transformers/integrations/awq.py Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com> * Update src/transformers/integrations/awq.py Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com> * move to top * add conversion test * final nit * add more elaborated test --------- Co-authored-by: Marc Sun <57196510+SunMarc@users.noreply.github.com> Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com> Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>		2023-11-01 09:06:31 +01:00
..
transformers-all-latest-gpu	[core / Quantization ] AWQ integration (#27045)	2023-11-01 09:06:31 +01:00
transformers-cpu	TF: TF 2.10 unpin + related onnx test skips (#18995)	2022-09-12 19:30:27 +01:00
transformers-doc-builder	Don't install pytorch-quantization in Doc Builder docker file (#26622)	2023-10-05 16:57:50 +02:00
transformers-gpu	TF: TF 2.10 unpin + related onnx test skips (#18995)	2022-09-12 19:30:27 +01:00
transformers-past-gpu	Byebye pytorch 1.9 (#24080)	2023-06-16 16:38:23 +02:00
transformers-pytorch-amd-gpu	Integrate AMD GPU in CI/CD environment (#26007)	2023-09-20 14:48:49 +02:00
transformers-pytorch-cpu	Adding Docker images for transformers + notebooks (#3051)	2020-03-04 11:45:57 -05:00
transformers-pytorch-deepspeed-latest-gpu	Update docker files to use torch==2.1.0 (#26735)	2023-10-11 16:23:36 +02:00
transformers-pytorch-deepspeed-nightly-gpu	Fix DeepSpeed stuff in the nightly CI (#23478)	2023-05-19 20:31:55 +02:00
transformers-pytorch-gpu	Fix transformers-pytorch-gpu docker build (#26615)	2023-10-05 15:33:35 +02:00
transformers-pytorch-tpu	Rename master to main for notebooks links and leftovers (#16397)	2022-03-25 09:12:23 -04:00
transformers-tensorflow-cpu	TF: TF 2.10 unpin + related onnx test skips (#18995)	2022-09-12 19:30:27 +01:00
transformers-tensorflow-gpu	Update TF pin in docker image (#25343)	2023-08-07 12:32:34 +02:00