transformers/docs/source/en/model_doc
Ritik Nandwal e87ac9d18b
Add swin transformer v2 (#17469)
* Add files generated using transformer-cli add-new-model-like command

* Add changes for swinv2 attention and forward method

* Add fixes

* Add modifications for weight conversion and remaining args in swin model

* Add changes for patchmerging

* Add changes for SwinV2selfattention

* Update conversion script

* Add final fixes for the swin_v2 model

* Add changes for conversion script for pretrained window size case

* Add pretrained window size value from config in SwinV2Encoder class

* Make fixup

* Add swinv2 to models_not_in_readme to utils/check_copies.py

* Modify Swinv2v2 to Swin Transformer V2

* Remove copied from, to run make fixup command

* Add updates to swinv2tf from main branch

* Add pretrained_window_size to config, to make tests pass

* Add modified weights from nandwalritik profile for swinv2

* Update model weights from swinv2 from nandwalritik profile

* Add fix for build_pr_documentation CI fix

* Add fixes for weight conversion

* Add change to make input with padding work

* Add fixes for test cases

* Add few changes from swin to swinv2 to pass test cases

* Remove tests for tensorflow as swinv2 for TF is not added yet

* Overide test_pt_tf_model_equivalence function as TF implementation for swinv2 is not added yet

* Add modeling_tf_swinv2 to _ignore_modules as test file is removed for this one right now.

* Update docs url for swinv2 in README.md

Co-authored-by: NielsRogge <48327001+NielsRogge@users.noreply.github.com>

* Undo changes for check_repo

* Update url in readme.md

* Remove overrided function to test pt_tf_model_equivalence

* Remove TF model imports for Swinv2 as its not implemented in this PR

* Add changes for index.mdx

* Add swinv2 papers link,abstract and contributors details

* Rename cpb_mlp to continous_position_bias_mlp

* Add tips for swinv2 model

* Update src/transformers/models/swinv2/configuration_swinv2.py

Co-authored-by: NielsRogge <48327001+NielsRogge@users.noreply.github.com>

* Update src/transformers/models/swinv2/configuration_swinv2.py

Co-authored-by: NielsRogge <48327001+NielsRogge@users.noreply.github.com>

* Fix indentation for docstring example in src/transformers/models/swinv2/configuration_swinv2.py

Co-authored-by: NielsRogge <48327001+NielsRogge@users.noreply.github.com>

* Update import order in src/transformers/models/swinv2/configuration_swinv2.py

Co-authored-by: NielsRogge <48327001+NielsRogge@users.noreply.github.com>

* Add copyright statements in weights conversion script.

Co-authored-by: NielsRogge <48327001+NielsRogge@users.noreply.github.com>

* Remove Swinv2 from models_not_in_readme

* Reformat code

* Remove TF implementation file for swinv2

* Update start docstring.

Co-authored-by: NielsRogge <48327001+NielsRogge@users.noreply.github.com>

* Add changes for docstring

* Update orgname for weights to microsoft

* Remove to_2tuple function

* Add copied from statements wherever applicable

* Add copied from to Swinv2ForMaskedImageModelling class

* Reformat code.

Co-authored-by: NielsRogge <48327001+NielsRogge@users.noreply.github.com>

* Add unittest.skip(with reason.) for test_inputs_embeds test case.

Co-authored-by: NielsRogge <48327001+NielsRogge@users.noreply.github.com>

* Add updates for test_modeling_swinv2.py

* Add @unittest.skip() annotation for clarity to create_and_test_config_common_properties function

* Add continuous_position_bias_mlp parameter to conversion script

* Add test for testing masked_image_modelling for swinv2

* Update Swinv2 to Swin Transformer v2 in docs/source/en/model_doc/swinv2.mdx

Co-authored-by: NielsRogge <48327001+NielsRogge@users.noreply.github.com>

* Update Swinv2 to Swin Transformer v2 in docs/source/en/model_doc/swinv2.mdx

Co-authored-by: NielsRogge <48327001+NielsRogge@users.noreply.github.com>

* Update docs/source/en/model_doc/swinv2.mdx

Co-authored-by: NielsRogge <48327001+NielsRogge@users.noreply.github.com>

* Update docs/source/en/model_doc/swinv2.mdx

Co-authored-by: NielsRogge <48327001+NielsRogge@users.noreply.github.com>

* Add suggested changes

* Add copied from to forward methods of Swinv2Stage and Swinv2Encoder

* Add push_to_hub flag to weight conversion script

* Change order or Swinv2DropPath class

* Add id2label mapping for imagenet 21k

* Add updated url for SwinV2 functions and classes used in implementation

* Update input_feature dimensions format, mentioned in comments.

Co-authored-by: Alara Dirik <8944735+alaradirik@users.noreply.github.com>

* Add suggested changes for modeling_swin2.py

* Update docs

* Remove create_and_test_config_common_properties function, as test_model_common_attributes is sufficient.

* Fix indentation.

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* Add changes for making Nit objects in code style

* Add suggested changes

* Add suggested changes for test_modelling_swinv2

* make fix-copies

* Update docs/source/en/model_doc/swinv2.mdx

Co-authored-by: NielsRogge <48327001+NielsRogge@users.noreply.github.com>
Co-authored-by: Alara Dirik <8944735+alaradirik@users.noreply.github.com>
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
2022-07-27 11:14:47 -04:00
..
albert.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
auto.mdx Add Visual Question Answering (VQA) pipeline (#17286) 2022-06-13 07:49:44 -04:00
bart.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
barthez.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
bartpho.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
beit.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
bert-generation.mdx Result of new doc style with fixes (#17015) 2022-04-29 17:42:15 -04:00
bert-japanese.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
bert.mdx Add a TF in-graph tokenizer for BERT (#17701) 2022-06-27 12:06:21 +01:00
bertweet.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
big_bird.mdx [FlaxBert] Add ForCausalLM (#16995) 2022-05-03 11:26:19 +02:00
bigbird_pegasus.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
blenderbot-small.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
blenderbot.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
bloom.mdx change bloom parameters to 176B (#18235) 2022-07-22 10:17:48 -04:00
bort.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
byt5.mdx [Doctests] Fix all T5 doc tests (#16646) 2022-04-13 11:36:54 +02:00
camembert.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
canine.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
clip.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
codegen.mdx Add CodeGen model (#17443) 2022-06-24 17:10:38 +02:00
convbert.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
convnext.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
cpm.mdx Allow all imports from transformers (#17050) 2022-05-02 12:47:39 -04:00
ctrl.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
cvt.mdx Add CvT (#17299) 2022-05-18 17:47:18 +02:00
data2vec.mdx Add TFData2VecVision for semantic segmentation (#17271) 2022-06-08 14:03:18 +01:00
deberta-v2.mdx Add DebertaV2ForMultipleChoice (#17135) 2022-05-10 16:21:44 -04:00
deberta.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
decision_transformer.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
deit.mdx Add TF DeiT implementation (#17806) 2022-07-13 18:04:08 +01:00
detr.mdx Fix Automatic Download of Pretrained Weights in DETR (#17712) 2022-06-21 16:45:35 +02:00
dialogpt.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
distilbert.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
dit.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
dpr.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
dpt.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
electra.mdx [FlaxBert] Add ForCausalLM (#16995) 2022-05-03 11:26:19 +02:00
encoder-decoder.mdx [EncoderDecoder] Improve docs (#18271) 2022-07-27 10:08:59 +02:00
flaubert.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
flava.mdx [feat] Add FLAVA model (#16654) 2022-05-11 14:56:48 -07:00
fnet.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
fsmt.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
funnel.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
glpn.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
gpt_neo.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
gpt_neox.mdx [WIP] Adding GPT-NeoX-20B (#16659) 2022-05-24 09:31:10 -04:00
gpt2.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
gptj.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
groupvit.mdx Adding GroupViT Models (#17313) 2022-06-28 20:51:47 +02:00
herbert.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
hubert.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
ibert.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
imagegpt.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
layoutlm.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
layoutlmv2.mdx Correct & Improve Doctests for LayoutLMv2 (#17168) 2022-05-23 08:02:31 -04:00
layoutlmv3.mdx Add LayoutLMv3 (#17060) 2022-05-24 09:53:45 +02:00
layoutxlm.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
led.mdx [LED] fix global_attention_mask not being passed for generation and docs clarification about grad checkpointing (#17112) 2022-05-17 23:44:37 +02:00
levit.mdx Adding LeViT Model by Facebook (#17466) 2022-06-01 17:06:20 +02:00
longformer.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
longt5.mdx Add LongT5 model (#16792) 2022-06-13 22:36:58 +02:00
luke.mdx Result of new doc style with fixes (#17015) 2022-04-29 17:42:15 -04:00
lxmert.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
m2m_100.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
marian.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
maskformer.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
mbart.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
mctct.mdx M-CTC-T Model (#16402) 2022-06-08 00:33:07 +02:00
megatron_gpt2.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
megatron-bert.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
mluke.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
mobilebert.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
mobilevit.mdx add MobileViT model (#17354) 2022-06-29 16:07:51 -04:00
mpnet.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
mt5.mdx Flax t5 Encoder (#17784) 2022-06-30 00:49:02 +02:00
mvp.mdx Add MVP model (#17787) 2022-06-29 09:30:55 -04:00
nezha.mdx Nezha Pytorch implementation (#17776) 2022-06-23 12:36:22 -04:00
nllb.mdx NLLB tokenizer (#18126) 2022-07-18 08:12:34 -04:00
nystromformer.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
openai-gpt.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
opt.mdx Adding OPTForSeqClassification class (#18123) 2022-07-20 10:14:21 +02:00
owlvit.mdx Owlvit docs test (#18257) 2022-07-26 10:55:14 +03:00
pegasus.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
perceiver.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
phobert.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
plbart.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
poolformer.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
prophetnet.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
qdqbert.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
rag.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
realm.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
reformer.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
regnet.mdx TF implementation of RegNets (#17554) 2022-06-29 13:45:14 +01:00
rembert.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
resnet.mdx Add TF ResNet model (#17427) 2022-07-04 10:59:15 +01:00
retribert.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
roberta.mdx [FlaxBert] Add ForCausalLM (#16995) 2022-05-03 11:26:19 +02:00
roformer.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
segformer.mdx [SegFormer] TensorFlow port (#17910) 2022-07-21 18:22:37 +01:00
sew-d.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
sew.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
speech_to_text_2.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
speech_to_text.mdx Fix some typos. (#17560) 2022-07-11 05:00:13 -04:00
speech-encoder-decoder.mdx [EncoderDecoder] Improve docs (#18271) 2022-07-27 10:08:59 +02:00
splinter.mdx Add support for pretraining recurring span selection to Splinter (#17247) 2022-05-17 23:42:14 +02:00
squeezebert.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
swin.mdx Add Tensorflow Swin model (#16988) 2022-05-16 22:19:53 +01:00
swinv2.mdx Add swin transformer v2 (#17469) 2022-07-27 11:14:47 -04:00
t5.mdx Flax t5 Encoder (#17784) 2022-06-30 00:49:02 +02:00
t5v1.1.mdx [Doctests] Fix all T5 doc tests (#16646) 2022-04-13 11:36:54 +02:00
tapas.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
tapex.mdx Add TAPEX (#16473) 2022-04-08 10:57:51 +02:00
trajectory_transformer.mdx Add trajectory transformer (#17141) 2022-05-17 19:07:43 -04:00
transfo-xl.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
trocr.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
ul2.mdx Add UL2 (just docs) (#17740) 2022-06-21 10:24:50 +02:00
unispeech-sat.mdx Add Wav2Vec2Conformer (#16812) 2022-05-17 00:43:16 +02:00
unispeech.mdx Add Wav2Vec2Conformer (#16812) 2022-05-17 00:43:16 +02:00
van.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
vilt.mdx Add ViltForTokenClassification e.g. for Named-Entity-Recognition (NER) (#17924) 2022-07-26 10:11:32 +02:00
vision-encoder-decoder.mdx [EncoderDecoder] Improve docs (#18271) 2022-07-27 10:08:59 +02:00
vision-text-dual-encoder.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
visual_bert.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
vit_mae.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
vit.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
wav2vec2_phoneme.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
wav2vec2-conformer.mdx [Wav2Vec2Conformer] Official release (#17709) 2022-06-15 18:34:15 +02:00
wav2vec2.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
wavlm.mdx Add Wav2Vec2Conformer (#16812) 2022-05-17 00:43:16 +02:00
xglm.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
xlm-prophetnet.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
xlm-roberta-xl.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
xlm-roberta.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
xlm.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
xlnet.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
xls_r.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
xlsr_wav2vec2.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
yolos.mdx Add YOLOS (#16848) 2022-05-02 18:30:55 +02:00
yoso.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00