transformers/tests
Pavel Iakubovskii a177821b24
Add FA2 and sdpa support for SigLIP (#31499)
* Rebase to main

* Fix attention implementation autoset for tex and vision configs

* Fixup

* Minor fixes

* Fix copies

* Fix attention_mask for FA2

* Add eqvivalence tests for siglip

* Remove right padding test

* Uncomment flaky

* Fix import

* Add to docs

* Fix test message

* Add sdpa

* Add sdpa equivalence test

* Add siglip sdpa to docs

* Fix typing for attention output

* Add sdpa tests

* Fix signature of FA2

* Autoset attn_implementation in config

* Rename bsz -> batch_size

* Move back autoset attn method

* Mark as flaky

* Correct attention mask padding

* [run-slow] siglip

* Add FA2 and sdpa docs

* Style fix

* Remove flaky for FA2 test

* Change attention implementation set

* Change attn_implementaiton propogation

* Fix typos

* Add modality to assert message

* Add more sdpa backends in test

* [run slow] siglip

* Add math sdpa backend for all options

* [run slow] siglip
2024-07-08 11:10:02 +01:00
..
agents Code agent: allow function persistence between steps (#31769) 2024-07-05 11:09:11 +02:00
benchmark [Test refactor 1/5] Per-folder tests reorganization (#15725) 2022-02-23 15:46:28 -05:00
bettertransformer Fixed malapropism error (#26660) 2023-10-09 11:04:57 +02:00
deepspeed Skip tests properly (#31308) 2024-06-26 21:59:08 +01:00
extended Skip tests properly (#31308) 2024-06-26 21:59:08 +01:00
fixtures Implementation of SuperPoint and AutoModelForKeypointDetection (#28966) 2024-03-19 14:43:02 +00:00
fsdp Llama et al. / FSDP : Fix breaking change in 4.40 for FSDP (#31161) 2024-06-26 14:50:08 +01:00
generation fix assisted decoding (#31401) 2024-07-03 09:22:56 +01:00
models Add FA2 and sdpa support for SigLIP (#31499) 2024-07-08 11:10:02 +01:00
optimization fix get_scheduler when name is warmup_stable_decay (#31128) 2024-05-30 15:25:43 +01:00
peft_integration FIX [CI]: Fix failing tests for peft integration (#29330) 2024-02-29 03:56:16 +01:00
pipelines Allow FP16 or other precision inference for Pipelines (#31342) 2024-07-05 17:21:50 +01:00
quantization Skip tests properly (#31308) 2024-06-26 21:59:08 +01:00
repo_utils Allow # Ignore copy (#27328) 2023-12-07 10:00:08 +01:00
sagemaker Pass datasets trust_remote_code (#31406) 2024-06-17 17:29:13 +01:00
tokenization Skip tests properly (#31308) 2024-06-26 21:59:08 +01:00
trainer Fix galore lr display with schedulers (#31710) 2024-07-05 18:59:09 +01:00
utils Fix serialization for offloaded model (#31727) 2024-07-05 08:07:07 +02:00
__init__.py
test_backbone_common.py Align backbone stage selection with out_indices & out_features (#27606) 2023-12-20 18:33:17 +00:00
test_configuration_common.py Move some test files (tets/test_xxx_utils.py) to tests/utils (#31730) 2024-07-02 13:46:03 +02:00
test_feature_extraction_common.py Split common test from core tests (#24284) 2023-06-15 07:30:24 -04:00
test_image_processing_common.py Skip tests properly (#31308) 2024-06-26 21:59:08 +01:00
test_image_transforms.py fix: center_crop occasionally outputs off-by-one dimension matrix (#30934) 2024-05-21 13:56:52 +01:00
test_modeling_common.py Move some test files (tets/test_xxx_utils.py) to tests/utils (#31730) 2024-07-02 13:46:03 +02:00
test_modeling_flax_common.py add sdpa to ViT [follow up of #29325] (#30555) 2024-05-16 10:56:11 +01:00
test_modeling_tf_common.py Port IDEFICS to tensorflow (#26870) 2024-05-13 15:59:46 +01:00
test_pipeline_mixin.py Allow FP16 or other precision inference for Pipelines (#31342) 2024-07-05 17:21:50 +01:00
test_processing_common.py add initial design for uniform processors + align model (#31197) 2024-06-13 16:27:16 +02:00
test_sequence_feature_extraction_common.py Fix typo (#25966) 2023-09-05 10:12:25 +02:00
test_tokenization_common.py Skip tests properly (#31308) 2024-06-26 21:59:08 +01:00