transformers/docs/source
Yih-Dar b67fd797be
Add TFVisionEncoderDecoderModel (#14148)
* Start the work on TFVisionEncoderDecoderModel

* Expose TFVisionEncoderDecoderModel

* fix import

* Add modeling_tf_vision_encoder_decoder to _ignore_modules in get_model_modules()

* reorder

* Apply the fix for checkpoint loading as in #14016

* remove attention_mask + fix VISION_DUMMY_INPUTS

* A minimal change to make TF generate() work for vision models as encoder in encoder-decoder setting

* fix wrong condition: shape_list(input_ids) == 2

* add tests

* use personal TFViTModel checkpoint (for now)

* Add equivalence tests + projection layer

* style

* make sure projection layer can run

* Add examples

* Apply suggestions from code review

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* Clean comments (need to work on TODOs for PyTorch models)

* Remove TF -> PT in check_pt_tf_equivalence for TFVisionEncoderDecoderModel

* fixes

* Revert changes in PT code.

* Update tests/test_modeling_tf_vision_encoder_decoder.py

Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

* Add test_inference_coco_en for TF test

* fix quality

* fix name

* build doc

* add main_input_name

* Fix ckpt name in test

* fix diff between master and this PR

* fix doc

* fix style and quality

* fix missing doc

* fix labels handling

* Delete auto.rst

* Add the changes done in #14016

* fix prefix

* Apply suggestions from code review

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* make style

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
2022-01-10 13:30:14 -05:00
..
internal Doc styler examples (#14953) 2021-12-27 19:07:46 -05:00
main_classes Use tqdm.auto in Pipeline docs (#14920) 2022-01-10 10:28:34 -05:00
model_doc Add TFVisionEncoderDecoderModel (#14148) 2022-01-10 13:30:14 -05:00
_config.py Prevent style_doc from tempering the config file 2021-12-10 15:31:43 -05:00
_toctree.yml Map model_type and doc pages names (#14944) 2022-01-03 05:08:55 -05:00
add_new_model.mdx Doc styler examples (#14953) 2021-12-27 19:07:46 -05:00
add_new_pipeline.mdx Doc styler examples (#14953) 2021-12-27 19:07:46 -05:00
benchmarks.mdx [doc] normalize HF Transformers string (#15023) 2022-01-10 08:44:33 -08:00
bertology.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
community.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
contributing.md Update installation page and add contributing to the doc (#5084) 2020-06-17 14:01:10 -04:00
converting_tensorflow_models.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
custom_datasets.mdx Doc styler examples (#14953) 2021-12-27 19:07:46 -05:00
debugging.mdx Doc styler examples (#14953) 2021-12-27 19:07:46 -05:00
examples.md per_device instead of per_gpu/error thrown when argument unknown (#4618) 2020-05-27 11:36:55 -04:00
fast_tokenizers.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
glossary.mdx Doc styler examples (#14953) 2021-12-27 19:07:46 -05:00
index.mdx Add TFVisionEncoderDecoderModel (#14148) 2022-01-10 13:30:14 -05:00
installation.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
migration.mdx Doc styler examples (#14953) 2021-12-27 19:07:46 -05:00
model_sharing.mdx Doc styler examples (#14953) 2021-12-27 19:07:46 -05:00
model_summary.mdx Model summary horizontal banners (#15058) 2022-01-10 10:06:14 -05:00
multilingual.mdx Doc styler examples (#14953) 2021-12-27 19:07:46 -05:00
notebooks.md Update notebooks (#3620) 2020-04-06 14:32:39 -04:00
parallelism.mdx [doc] Update parallelism.mdx (#15018) 2022-01-04 09:58:27 -08:00
performance.mdx [performance doc] Power and Cooling (#14935) 2022-01-10 09:21:04 -08:00
perplexity.mdx Doc styler examples (#14953) 2021-12-27 19:07:46 -05:00
philosophy.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
pr_checks.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
preprocessing.mdx Doc styler examples (#14953) 2021-12-27 19:07:46 -05:00
quicktour.mdx Doc styler examples (#14953) 2021-12-27 19:07:46 -05:00
sagemaker.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00
serialization.mdx Resubmit changes after rebase to master (#14982) 2022-01-07 08:34:12 +01:00
task_summary.mdx Doc styler examples (#14953) 2021-12-27 19:07:46 -05:00
testing.mdx [doc] normalize HF Transformers string (#15023) 2022-01-10 08:44:33 -08:00
tokenizer_summary.mdx Doc styler examples (#14953) 2021-12-27 19:07:46 -05:00
training.mdx Doc styler examples (#14953) 2021-12-27 19:07:46 -05:00
troubleshooting.mdx Convert rst files (#14888) 2021-12-22 16:14:35 -05:00