transformers/docs/source/ja
Yoni Gozlan 203e27059b
Add image text to text pipeline (#34170)
* Standardize image-text-to-text-models-output

add post_process_image_text_to_text to chameleon and cleanup

Fix legacy kwarg behavior and deprecation warning

add post_process_image_text_to_text to qwen2_vl and llava_onevision

Add post_process_image_text_to_text to idefics3, mllama, pixtral processor

* nit var name post_process_image_text_to_text udop

* nit fix deprecation warnings

* Add image-text-to-text pipeline

* add support for image url in chat template for pipeline

* Reformat to be fully compatible with chat templates

* Add tests chat template

* Fix imports and tests

* Add pipeline tag

* change logic handling of single prompt ans multiple images

* add pipeline mapping to models

* fix batched inference

* fix tests

* Add manual batching for preprocessing

* Fix outputs with nested images

* Add support for all common processing kwargs

* Add default padding when multiple text inputs (batch size>1)

* nit change version deprecation warning

* Add support for text only inference

* add chat_template warnings

* Add pipeline tests and add copied from post process function

* Fix batched pipeline tests

* nit

* Fix pipeline tests blip2

* remove unnecessary max_new_tokens

* revert processing kosmos2 and remove unnecessary max_new_tokens

* fix pipeline tests idefics

* Force try loading processor if pipeline supports it

* revert load_processor change

* hardcode loading only processor

* remove unnecessary try except

* skip imagetexttotext tests for kosmos2 as tiny model causes problems

* Make code clearer

* Address review comments

* remove preprocessing logic from pipeline

* fix fuyu

* add BC resize fuyu

* Move post_process_image_text_to_text to ProcessorMixin

* add guard in post_process

* fix zero shot object detection pipeline

* add support for generator input in pipeline

* nit

* change default image-text-to-text model to llava onevision

* fix owlv2 size dict

* Change legacy deprecation warning to only show when True
2024-10-31 15:48:11 -04:00
..
internal
main_classes Add image text to text pipeline (#34170) 2024-10-31 15:48:11 -04:00
model_doc
tasks
_toctree.yml
accelerate.md
add_new_model.md
attention.md
autoclass_tutorial.md
benchmarks.md
bertology.md
big_models.md
chat_templating.md
community.md
create_a_model.md
custom_models.md
custom_tools.md
fast_tokenizers.md
generation_strategies.md
glossary.md
hpo_train.md
index.md
installation.md
llm_tutorial.md
model_memory_anatomy.md
model_sharing.md
model_summary.md
multilingual.md
pad_truncation.md
peft.md
perf_hardware.md
perf_infer_cpu.md
perf_infer_gpu_many.md
perf_infer_gpu_one.md
perf_infer_special.md
perf_torch_compile.md
perf_train_cpu_many.md
perf_train_cpu.md
perf_train_gpu_many.md
perf_train_gpu_one.md
perf_train_special.md
perf_train_tpu_tf.md
perf_train_tpu.md
performance.md
perplexity.md
philosophy.md
pipeline_tutorial.md
pipeline_webserver.md
pr_checks.md
preprocessing.md
quicktour.md
run_scripts.md
serialization.md
task_summary.md
tasks_explained.md
testing.md
tf_xla.md
tflite.md
tokenizer_summary.md
torchscript.md
training.md
transformers_agents.md
troubleshooting.md