transformers/tests/utils
Yoni Gozlan 203e27059b
Add image text to text pipeline (#34170)
* Standardize image-text-to-text-models-output

add post_process_image_text_to_text to chameleon and cleanup

Fix legacy kwarg behavior and deprecation warning

add post_process_image_text_to_text to qwen2_vl and llava_onevision

Add post_process_image_text_to_text to idefics3, mllama, pixtral processor

* nit var name post_process_image_text_to_text udop

* nit fix deprecation warnings

* Add image-text-to-text pipeline

* add support for image url in chat template for pipeline

* Reformat to be fully compatible with chat templates

* Add tests chat template

* Fix imports and tests

* Add pipeline tag

* change logic handling of single prompt ans multiple images

* add pipeline mapping to models

* fix batched inference

* fix tests

* Add manual batching for preprocessing

* Fix outputs with nested images

* Add support for all common processing kwargs

* Add default padding when multiple text inputs (batch size>1)

* nit change version deprecation warning

* Add support for text only inference

* add chat_template warnings

* Add pipeline tests and add copied from post process function

* Fix batched pipeline tests

* nit

* Fix pipeline tests blip2

* remove unnecessary max_new_tokens

* revert processing kosmos2 and remove unnecessary max_new_tokens

* fix pipeline tests idefics

* Force try loading processor if pipeline supports it

* revert load_processor change

* hardcode loading only processor

* remove unnecessary try except

* skip imagetexttotext tests for kosmos2 as tiny model causes problems

* Make code clearer

* Address review comments

* remove preprocessing logic from pipeline

* fix fuyu

* add BC resize fuyu

* Move post_process_image_text_to_text to ProcessorMixin

* add guard in post_process

* fix zero shot object detection pipeline

* add support for generator input in pipeline

* nit

* change default image-text-to-text model to llava onevision

* fix owlv2 size dict

* Change legacy deprecation warning to only show when True
2024-10-31 15:48:11 -04:00
..
import_structures Import structure & first three model refactors (#31329) 2024-09-10 11:10:53 +02:00
__init__.py [Test refactor 1/5] Per-folder tests reorganization (#15725) 2022-02-23 15:46:28 -05:00
test_activations_tf.py TF: Add sigmoid activation function (#16819) 2022-04-19 16:13:08 +01:00
test_activations.py Add the GeLU activation from pytorch with the tanh approximation (#21345) 2023-02-02 09:33:04 -05:00
test_add_new_model_like.py fix: Fixed failing tests in tests/utils/test_add_new_model_like.py (#32678) 2024-08-14 12:06:17 +01:00
test_audio_utils.py Remove trust_remote_code when loading Libri Dummy (#31748) 2024-07-23 14:54:38 +08:00
test_backbone_utils.py 🚨 out_indices always a list (#30941) 2024-05-22 15:23:04 +01:00
test_cache_utils.py Cache: revert DynamicCache init for BC (#33861) 2024-10-04 22:47:08 +02:00
test_chat_template_utils.py Make tool JSON schemas consistent (#31756) 2024-07-02 20:00:42 +01:00
test_cli.py Forbid PretrainedConfig from saving generate parameters; Update deprecations in generate-related code 🧹 (#32659) 2024-08-23 11:12:53 +01:00
test_configuration_utils.py Attn implementation for composite models (#32238) 2024-10-22 06:54:44 +02:00
test_convert_slow_tokenizer.py Revert error back into warning for byte fallback conversion. (#22607) 2023-04-06 14:00:29 +02:00
test_deprecation.py Decorators for deprecation and named arguments validation (#30799) 2024-06-10 12:35:10 +01:00
test_doc_samples.py Skip tests properly (#31308) 2024-06-26 21:59:08 +01:00
test_dynamic_module_utils.py Fix the regex in get_imports to support multiline try blocks and excepts with specific exception types (#23725) 2023-05-24 15:40:19 -04:00
test_feature_extraction_utils.py Fix import paths for test_module (#32888) 2024-08-28 12:08:29 +01:00
test_file_utils.py Inheritance-based framework detection (#21784) 2023-02-27 15:31:55 +00:00
test_generic.py Decorators for deprecation and named arguments validation (#30799) 2024-06-10 12:35:10 +01:00
test_hf_argparser.py HfArgumentParser: allow for hyhenated field names in long-options (#33990) 2024-10-10 11:58:26 +02:00
test_hub_utils.py Use HF_HUB_OFFLINE + fix has_file in offline mode (#31016) 2024-05-29 11:55:43 +01:00
test_image_processing_utils.py Fix import paths for test_module (#32888) 2024-08-28 12:08:29 +01:00
test_image_utils.py fix: Replaced deprecated mktemp() function (#32123) 2024-07-22 14:13:39 +01:00
test_import_structure.py Fix some missing tests in circleci (#33559) 2024-09-20 20:58:51 +02:00
test_logging.py Fix flaky test for log level (#21776) 2023-02-28 16:24:14 -05:00
test_model_card.py Automatically add transformers tag to the modelcard (#32623) 2024-08-13 07:59:01 +02:00
test_model_output.py Skip tests properly (#31308) 2024-06-26 21:59:08 +01:00
test_modeling_flax_utils.py Follow up for #31973 (#32025) 2024-07-25 16:12:23 +02:00
test_modeling_rope_utils.py Ignore keys on validate_rope (#33753) 2024-10-04 12:39:37 +02:00
test_modeling_tf_core.py Add tf_keras imports to prepare for Keras 3 (#28588) 2024-01-30 17:26:36 +00:00
test_modeling_tf_utils.py Follow up for #31973 (#32025) 2024-07-25 16:12:23 +02:00
test_modeling_utils.py use a tinymodel to test generation config which aviod timeout (#34482) 2024-10-29 09:39:06 +01:00
test_offline.py Use HF_HUB_OFFLINE + fix has_file in offline mode (#31016) 2024-05-29 11:55:43 +01:00
test_processing_utils.py Uniformize kwargs for Pixtral processor (#33521) 2024-09-17 14:44:27 -04:00
test_skip_decorators.py Update quality tooling for formatting (#21480) 2023-02-06 18:10:56 -05:00
test_tokenization_utils.py [fix] fix token healing tests and usage errors (#33931) 2024-10-16 14:22:55 +02:00
test_versions_utils.py improve dev setup comments and hints (#28495) 2024-01-15 18:36:40 +00:00
tiny_model_summary.json Add image text to text pipeline (#34170) 2024-10-31 15:48:11 -04:00