transformers/tests/pipelines
NielsRogge 3b742ea84c
Add SigLIP (#26522)
* Add first draft

* Use appropriate gelu function

* More improvements

* More improvements

* More improvements

* Convert checkpoint

* More improvements

* Improve docs, remove print statements

* More improvements

* Add link

* remove unused masking function

* begin tokenizer

* do_lower_case

* debug

* set split_special_tokens=True

* Remove script

* Fix style

* Fix rebase

* Use same design as CLIP

* Add fast tokenizer

* Add SiglipTokenizer to init, remove extra_ids

* Improve conversion script

* Use smaller inputs in conversion script

* Update conversion script

* More improvements

* Add processor to conversion script

* Add tests

* Remove print statements

* Add tokenizer tests

* Fix more tests

* More improvements related to weight initialization

* More improvements

* Make more tests pass

* More improvements

* More improvements

* Add copied from

* Add canonicalize_text

* Enable fast tokenizer tests

* More improvements

* Fix most slow tokenizer tests

* Address comments

* Fix style

* Remove script

* Address some comments

* Add copied from to tests

* Add more copied from

* Add more copied from

* Add more copied from

* Remove is_flax_available

* More updates

* Address comment

* Remove SiglipTokenizerFast for now

* Add caching

* Remove umt5 test

* Add canonicalize_text inside _tokenize, thanks Arthur

* Fix image processor tests

* Skip tests which are not applicable

* Skip test_initialization

* More improvements

* Compare pixel values

* Fix doc tests, add integration test

* Add do_normalize

* Remove causal mask and leverage ignore copy

* Fix attention_mask

* Fix remaining tests

* Fix dummies

* Rename temperature and bias

* Address comments

* Add copied from to tokenizer tests

* Add SiglipVisionModel to auto mapping

* Add copied from to image processor tests

* Improve doc

* Remove SiglipVisionModel from index

* Address comments

* Improve docs

* Simplify config

* Add first draft

* Make it like mistral

* More improvements

* Fix attention_mask

* Fix output_attentions

* Add note in docs

* Convert multilingual model

* Convert large checkpoint

* Convert more checkpoints

* Add pipeline support, correct image_mean and image_std

* Use padding=max_length by default

* Make processor like llava

* Add code snippet

* Convert more checkpoints

* Set keep_punctuation_string=None as in OpenCLIP

* Set normalized=False for special tokens

* Fix doc test

* Update integration test

* Add figure

* Update organization

* Happy new year

* Use AutoModel everywhere

---------

Co-authored-by: patil-suraj <surajp815@gmail.com>
2024-01-08 18:17:16 +01:00
..
__init__.py
test_pipelines_audio_classification.py Allow dict input for audio classification pipeline (#23445) 2023-06-23 13:50:37 +01:00
test_pipelines_automatic_speech_recognition.py [Whisper] Fix word-level timestamps with bs>1 or num_beams>1 (#28114) 2023-12-22 12:43:11 +00:00
test_pipelines_common.py Fix RequestCounter to make it more future-proof (#27406) 2023-11-09 18:53:26 +01:00
test_pipelines_conversational.py [Styling] stylify using ruff (#27144) 2023-11-16 17:43:19 +01:00
test_pipelines_depth_estimation.py Update fixtures-image-utils (#28080) 2023-12-15 16:58:36 +00:00
test_pipelines_document_question_answering.py
test_pipelines_feature_extraction.py
test_pipelines_fill_mask.py Fix 2 tests in FillMaskPipelineTests (#27889) 2023-12-08 14:55:29 +01:00
test_pipelines_image_classification.py Update fixtures-image-utils (#28080) 2023-12-15 16:58:36 +00:00
test_pipelines_image_segmentation.py Update fixtures-image-utils (#28080) 2023-12-15 16:58:36 +00:00
test_pipelines_image_to_image.py Add image to image pipeline (#25393) 2023-09-22 19:53:55 +03:00
test_pipelines_image_to_text.py [Llava] Add Llava to transformers (#27662) 2023-12-07 09:30:47 +01:00
test_pipelines_mask_generation.py Set usedforsecurity=False in hashlib methods (FIPS compliance) (#27483) 2023-11-16 14:29:53 +00:00
test_pipelines_object_detection.py Update fixtures-image-utils (#28080) 2023-12-15 16:58:36 +00:00
test_pipelines_question_answering.py [Styling] stylify using ruff (#27144) 2023-11-16 17:43:19 +01:00
test_pipelines_summarization.py Proper build() methods for TF (#27794) 2023-12-14 15:17:30 +00:00
test_pipelines_table_question_answering.py Skip some TQAPipelineTests tests in past CI (#24267) 2023-06-14 14:25:24 +02:00
test_pipelines_text_classification.py device agnostic pipelines testing (#27129) 2023-10-31 15:46:31 +01:00
test_pipelines_text_generation.py Don't check the device when device_map=auto (#28351) 2024-01-05 12:21:29 +01:00
test_pipelines_text_to_audio.py Enrich TTS pipeline parameters naming (#26473) 2023-11-02 17:06:56 +00:00
test_pipelines_text2text_generation.py
test_pipelines_token_classification.py [Styling] stylify using ruff (#27144) 2023-11-16 17:43:19 +01:00
test_pipelines_translation.py
test_pipelines_video_classification.py
test_pipelines_visual_question_answering.py device agnostic pipelines testing (#27129) 2023-10-31 15:46:31 +01:00
test_pipelines_zero_shot_audio_classification.py Enable ZeroShotAudioClassificationPipelineTests::test_small_model_pt (#24882) 2023-07-18 15:08:53 +02:00
test_pipelines_zero_shot_image_classification.py Add SigLIP (#26522) 2024-01-08 18:17:16 +01:00
test_pipelines_zero_shot_object_detection.py
test_pipelines_zero_shot.py