transformers/docs/source/en/main_classes
Marc Sun 55db70c63d
GPTQ integration (#25062)
* GTPQ integration

* Add tests for gptq

* support for more quantization model

* fix style

* typo

* fix method

* Update src/transformers/modeling_utils.py

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* add dataclass and fix quantization_method

* fix doc

* Update tests/quantization/gptq/test_gptq.py

Co-authored-by: Younes Belkada <49240599+younesbelkada@users.noreply.github.com>

* Apply suggestions from code review

Co-authored-by: Younes Belkada <49240599+younesbelkada@users.noreply.github.com>

* modify dataclass

* add gtpqconfig import

* fix typo

* fix tests

* remove dataset as req arg

* remove tokenizer import

* add offload cpu quantization test

* fix check dataset

* modify dockerfile

* protect trainer

* style

* test for config

* add more log

* overwrite torch_dtype

* draft doc

* modify quantization_config docstring

* fix class name in docstring

* Apply suggestions from code review

Co-authored-by: Younes Belkada <49240599+younesbelkada@users.noreply.github.com>

* more warning

* fix 8bit kwargs tests

* peft compatibility

* remove var

* fix is_gptq_quantized

* remove is_gptq_quantized

* fix wrap

* Update src/transformers/modeling_utils.py

Co-authored-by: Younes Belkada <49240599+younesbelkada@users.noreply.github.com>

* add exllama

* skip test

* overwrite float16

* style

* fix skip test

* Apply suggestions from code review

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* fix docsting formatting

* add doc

* better test

---------

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
Co-authored-by: Younes Belkada <49240599+younesbelkada@users.noreply.github.com>
2023-08-10 16:06:29 -04:00
..
agent.md Migrate doc files to Markdown. (#24376) 2023-06-20 18:07:47 -04:00
callback.md Migrate doc files to Markdown. (#24376) 2023-06-20 18:07:47 -04:00
configuration.md Migrate doc files to Markdown. (#24376) 2023-06-20 18:07:47 -04:00
data_collator.md Migrate doc files to Markdown. (#24376) 2023-06-20 18:07:47 -04:00
deepspeed.md recommend DeepSpeed's Argument Parsing documentation (#25268) 2023-08-02 11:48:39 -04:00
feature_extractor.md Migrate doc files to Markdown. (#24376) 2023-06-20 18:07:47 -04:00
image_processor.md Migrate doc files to Markdown. (#24376) 2023-06-20 18:07:47 -04:00
keras_callbacks.md Migrate doc files to Markdown. (#24376) 2023-06-20 18:07:47 -04:00
logging.md Migrate doc files to Markdown. (#24376) 2023-06-20 18:07:47 -04:00
model.md Fix typo 'submosules' (#24809) 2023-07-13 16:56:53 +01:00
onnx.md Migrate doc files to Markdown. (#24376) 2023-06-20 18:07:47 -04:00
optimizer_schedules.md Migrate doc files to Markdown. (#24376) 2023-06-20 18:07:47 -04:00
output.md Migrate doc files to Markdown. (#24376) 2023-06-20 18:07:47 -04:00
pipelines.md Migrate doc files to Markdown. (#24376) 2023-06-20 18:07:47 -04:00
processors.md Migrate doc files to Markdown. (#24376) 2023-06-20 18:07:47 -04:00
quantization.md GPTQ integration (#25062) 2023-08-10 16:06:29 -04:00
text_generation.md Migrate doc files to Markdown. (#24376) 2023-06-20 18:07:47 -04:00
tokenizer.md Migrate doc files to Markdown. (#24376) 2023-06-20 18:07:47 -04:00
trainer.md fsdp fixes and enhancements (#24980) 2023-07-21 17:52:48 +05:30