jiqing-feng 11c27dd331 Enable BNB multi-backend support (#31098) ... * enable cpu bnb path * fix style * fix code style * fix 4 bit path * Update src/transformers/utils/import_utils.py Co-authored-by: Aarni Koskela <akx@iki.fi> * add multi backend refactor tests * fix style * tweak 4bit quantizer + fix corresponding tests * tweak 8bit quantizer + *try* fixing corresponding tests * fix dequant bnb 8bit * account for Intel CPU in variability of expected outputs * enable cpu and xpu device map * further tweaks to account for Intel CPU * fix autocast to work with both cpu + cuda * fix comments * fix comments * switch to testing_utils.torch_device * allow for xpu in multi-gpu tests * fix tests 4bit for CPU NF4 * fix bug with is_torch_xpu_available needing to be called as func * avoid issue where test reports attr err due to other failure * fix formatting * fix typo from resolving of merge conflict * polish based on last PR review Co-authored-by: Marc Sun <57196510+SunMarc@users.noreply.github.com> * fix CI * Update src/transformers/integrations/integration_utils.py Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com> * Update src/transformers/integrations/integration_utils.py Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com> * fix error log * fix error msg * add \n in error log * make quality * rm bnb cuda restriction in doc * cpu model don't need dispatch * fix doc * fix style * check cuda avaliable in testing * fix tests * Update docs/source/en/model_doc/chameleon.md Co-authored-by: Marc Sun <57196510+SunMarc@users.noreply.github.com> * Update docs/source/en/model_doc/llava_next.md Co-authored-by: Aarni Koskela <akx@iki.fi> * Update tests/quantization/bnb/test_4bit.py Co-authored-by: Aarni Koskela <akx@iki.fi> * Update tests/quantization/bnb/test_4bit.py Co-authored-by: Aarni Koskela <akx@iki.fi> * fix doc * fix check multibackends * fix import sort * remove check torch in bnb * docs: update bitsandbytes references with multi-backend info * docs: fix small mistakes in bnb paragraph * run formatting * reveret bnb check * move bnb multi-backend check to import_utils * Update src/transformers/utils/import_utils.py Co-authored-by: Aarni Koskela <akx@iki.fi> * fix bnb check * minor fix for bnb * check lib first * fix code style * Revert "run formatting" This reverts commit ac108c6d6b. * fix format * give warning when bnb version is low and no cuda found] * fix device assignment check to be multi-device capable * address akx feedback on get_avlbl_dev fn * revert partially, as we don't want the function that public, as docs would be too much (enforced) --------- Co-authored-by: Aarni Koskela <akx@iki.fi> Co-authored-by: Titus von Koeller <9048635+Titus-von-Koeller@users.noreply.github.com> Co-authored-by: Marc Sun <57196510+SunMarc@users.noreply.github.com> Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>		2024-09-24 03:40:56 -06:00
..
agents	Decorator for easier tool building (#33439)	2024-09-18 11:07:51 +02:00
benchmark	[Test refactor 1/5] Per-folder tests reorganization (#15725)	2022-02-23 15:46:28 -05:00
bettertransformer	Fixed malapropism error (#26660)	2023-10-09 11:04:57 +02:00
deepspeed	Revert PR 32299, flag users when Zero-3 was missed (#32851)	2024-08-16 12:35:41 -04:00
extended	[tests] skip tests for xpu (#33553)	2024-09-19 19:28:04 +01:00
fixtures	Implementation of SuperPoint and AutoModelForKeypointDetection (#28966)	2024-03-19 14:43:02 +00:00
fsdp	🚨🚨🚨 Update min version of accelerate to 0.26.0 (#32627)	2024-08-20 11:42:36 +02:00
generation	Generation: deprecate PreTrainedModel inheriting from GenerationMixin (#33203)	2024-09-23 18:28:36 +01:00
models	Generation: deprecate PreTrainedModel inheriting from GenerationMixin (#33203)	2024-09-23 18:28:36 +01:00
optimization	fix: Fixed the 1st argument name in classmethods (#31907)	2024-07-11 12:11:50 +01:00
peft_integration	FIX [CI]: Fix failing tests for peft integration (#29330)	2024-02-29 03:56:16 +01:00
pipelines	enable low-precision pipeline (#31625)	2024-09-20 16:43:30 -07:00
quantization	Enable BNB multi-backend support (#31098)	2024-09-24 03:40:56 -06:00
repo_utils	Refactor CI: more explicit (#30674)	2024-08-30 18:17:25 +02:00
sagemaker	Fixed log messages that are resulting in TypeError due to too many arguments (#32017)	2024-07-17 10:56:44 +01:00
tokenization	Fix for slow the bug tokenizer adding spaces to single id decodes (#32564)	2024-09-18 12:32:02 +02:00
trainer	[tests] skip tests for xpu (#33553)	2024-09-19 19:28:04 +01:00
utils	Generation: deprecate PreTrainedModel inheriting from GenerationMixin (#33203)	2024-09-23 18:28:36 +01:00
__init__.py	GPU text generation: mMoved the encoded_prompt to correct device	2020-01-06 15:11:12 +01:00
test_backbone_common.py	Align backbone stage selection with out_indices & out_features (#27606)	2023-12-20 18:33:17 +00:00
test_configuration_common.py	Refactor: Removed un-necessary object base class (#32230)	2024-07-26 10:33:02 +02:00
test_feature_extraction_common.py	Split common test from core tests (#24284)	2023-06-15 07:30:24 -04:00
test_image_processing_common.py	Update kwargs validation for preprocess with decorator (#32024)	2024-08-06 11:33:05 +01:00
test_image_transforms.py	fix: center_crop occasionally outputs off-by-one dimension matrix (#30934)	2024-05-21 13:56:52 +01:00
test_modeling_common.py	[tests] make more tests device-agnostic (#33580)	2024-09-20 10:16:43 +01:00
test_modeling_flax_common.py	add sdpa to ViT [follow up of #29325] (#30555)	2024-05-16 10:56:11 +01:00
test_modeling_tf_common.py	Port IDEFICS to tensorflow (#26870)	2024-05-13 15:59:46 +01:00
test_pipeline_mixin.py	Config: unified logic to retrieve text config (#33219)	2024-09-04 12:03:30 +01:00
test_processing_common.py	Clean up Unpack imports (#33631)	2024-09-23 10:21:17 +02:00
test_sequence_feature_extraction_common.py	Fix typo (#25966)	2023-09-05 10:12:25 +02:00
test_tokenization_common.py	Enable padding_side as call time kwargs (#33385)	2024-09-13 11:58:38 +01:00