transformers/tests
fxmarty-amd 1a374799ce
Support loading Quark quantized models in Transformers (#36372)
* add quark quantizer

* add quark doc

* clean up doc

* fix tests

* make style

* more style fixes

* cleanup imports

* cleaning

* precise install

* Update docs/source/en/quantization/quark.md

Co-authored-by: Marc Sun <57196510+SunMarc@users.noreply.github.com>

* Update tests/quantization/quark_integration/test_quark.py

Co-authored-by: Marc Sun <57196510+SunMarc@users.noreply.github.com>

* Update src/transformers/utils/quantization_config.py

Co-authored-by: Marc Sun <57196510+SunMarc@users.noreply.github.com>

* remove import guard as suggested

* update copyright headers

* add quark to transformers-quantization-latest-gpu Dockerfile

* make tests pass on transformers main + quark==0.7

* add missing F8_E4M3 and F8_E5M2 keys from str_to_torch_dtype

---------

Co-authored-by: Marc Sun <57196510+SunMarc@users.noreply.github.com>
Co-authored-by: Bowen Bao <bowenbao@amd.com>
Co-authored-by: Mohamed Mekkouri <93391238+MekkCyber@users.noreply.github.com>
2025-03-20 15:40:51 +01:00
..
agents use torch.testing.assertclose instead to get more details about error in cis (#35659) 2025-01-24 16:55:28 +01:00
bettertransformer Fix typos in tests (#36547) 2025-03-05 15:04:06 -08:00
deepspeed fix typos in the tests directory (#36717) 2025-03-17 17:45:57 +00:00
extended [tests] skip tests for xpu (#33553) 2024-09-19 19:28:04 +01:00
fixtures Implementation of SuperPoint and AutoModelForKeypointDetection (#28966) 2024-03-19 14:43:02 +00:00
fsdp HPU support (#36424) 2025-03-12 09:08:12 +01:00
generation [generate] vectorized beam search (#35802) 2025-03-18 18:39:36 +00:00
models Shieldgemma2 (#36678) 2025-03-20 15:14:38 +01:00
optimization Just import torch AdamW instead (#36177) 2025-03-19 18:29:40 +00:00
peft_integration Fix pipeline+peft interaction (#36480) 2025-03-03 18:01:43 +00:00
pipelines chore: fix typos in tests directory (#36785) 2025-03-18 10:31:13 +01:00
quantization Support loading Quark quantized models in Transformers (#36372) 2025-03-20 15:40:51 +01:00
repo_utils [Modular] skip modular checks based on diff (#36130) 2025-02-13 12:53:21 +00:00
sagemaker Trainer - deprecate tokenizer for processing_class (#32385) 2024-10-02 14:08:46 +01:00
tensor_parallel fix typos in the tests directory (#36717) 2025-03-17 17:45:57 +00:00
tokenization Fix PretrainedTokenizerFast check => Fix PretrainedTokenizerFast Save (#35835) 2025-02-13 12:00:33 +01:00
trainer Saving Trainer.collator.tokenizer in when Trainer.processing_class is None (#36552) 2025-03-20 11:27:47 +01:00
utils Support tracable dynamicKVcache (#36311) 2025-03-19 16:52:30 +00:00
__init__.py GPU text generation: mMoved the encoded_prompt to correct device 2020-01-06 15:11:12 +01:00
test_backbone_common.py Align backbone stage selection with out_indices & out_features (#27606) 2023-12-20 18:33:17 +00:00
test_configuration_common.py Fix typos in tests (#36547) 2025-03-05 15:04:06 -08:00
test_feature_extraction_common.py Split common test from core tests (#24284) 2023-06-15 07:30:24 -04:00
test_image_processing_common.py Make the flaky list a little more general (#36704) 2025-03-14 12:15:32 +00:00
test_image_transforms.py Uses Collection in transformers.image_transforms.normalize (#36301) 2025-02-21 18:38:41 +01:00
test_modeling_common.py [CI] remove redundant checks in test_eager_matches_sdpa_inference (#36740) 2025-03-17 16:29:18 +00:00
test_modeling_flax_common.py Fix typos in tests (#36547) 2025-03-05 15:04:06 -08:00
test_modeling_tf_common.py fix typos in the tests directory (#36717) 2025-03-17 17:45:57 +00:00
test_pipeline_mixin.py Add image text to text pipeline (#34170) 2024-10-31 15:48:11 -04:00
test_processing_common.py Gemma3 (#36658) 2025-03-12 09:06:17 +01:00
test_sequence_feature_extraction_common.py Fix typo (#25966) 2023-09-05 10:12:25 +02:00
test_tokenization_common.py Fix typos in tests (#36547) 2025-03-05 15:04:06 -08:00
test_training_args.py Fix TrainingArguments.torch_empty_cache_steps post_init check (#36734) 2025-03-17 16:09:46 +01:00