Jegor Kitškerkin
|
8a5e8a9c2a
|
Add ViViT (#22518)
* Add model
* Add ability to get classification head weights
* Add docs
* Add imports to __init__.py
* Run style
* Fix imports and add mdx doc
* Run style
* Fix copyright
* Fix config docstring
* Remove imports of ViViTLayer and load_tf_weights_in_vivit
* Remove FeatureExtractor and replace with ImageProcessor everywhere
* Remove ViViTForPreTraining from vivit.mdx
* Change ViViT -> Vivit everywhere
* Add model_doc to _toctree.yml
* Replace tuples with lists in arguments of VivitConfig
* Rename patch_size to tubelet_size in TubeletEmbeddings
* Fix checkpoint names
* Add tests
* Remove unused num_frames
* Fix imports for VivitImageProcessor
* Minor fixes
* Decrease number of frames in VivitModelTester from 32 to 16
* Decrease number of frames in VivitModelTester from 16 to 8
* Add initialization for pos embeddings
* Rename Vivit -> ViViT in some places
* Fix docstring and formatting
* Rename TubeletEmbeddings -> VivitTubeletEmbeddings
* Remove load_tf_weights_in_vivit
* Change checkpoint name
* Remove Vivit _TOKENIZER_FOR_DOC
* Fix
* Fix VivitTubeletEmbeddings and pass config object as parameter
* Use image_size and num_frames instead of video_size
* Change conversion script and fix differences with the orig implementation
* Fix docstrings
* Add attention head pruning
* Run style and fixup
* Fix tests
* Add ViViT to video_classification.mdx
* Save processor in conversion script
* Fix
* Add image processor test
* Run fixup and style
* Run fix-copies
* Update tests/models/vivit/test_modeling_vivit.py
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
* Update tests/models/vivit/test_modeling_vivit.py
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
* Update src/transformers/models/vivit/modeling_vivit.py
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
* Use PyAV instead of decord
* Add unittest.skip
* Run style
* Remove unneeded test
* Update docs/source/en/model_doc/vivit.mdx
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
* Update src/transformers/models/vivit/configuration_vivit.py
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
* Update src/transformers/models/vivit/modeling_vivit.py
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
* Update src/transformers/models/vivit/image_processing_vivit.py
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
* Update src/transformers/models/vivit/modeling_vivit.py
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
* Update src/transformers/models/vivit/modeling_vivit.py
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
* Update src/transformers/models/vivit/image_processing_vivit.py
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
* Update src/transformers/models/vivit/modeling_vivit.py
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
* Add model
* Add docs
* Run style
* Fix imports and add mdx doc
* Remove FeatureExtractor and replace with ImageProcessor everywhere
* Change ViViT -> Vivit everywhere
* Rename Vivit -> ViViT in some places
* Update src/transformers/models/vivit/image_processing_vivit.py
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
* Run make style
* Remove inputs save
* Fix image processor
* Fix
* Run `make style`
* Decrease parameters of VivitModelTester
* Decrease tubelet size
* Rename vivit.mdx
* Update src/transformers/models/vivit/image_processing_vivit.py
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
* Update src/transformers/models/vivit/image_processing_vivit.py
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
* Update src/transformers/models/vivit/image_processing_vivit.py
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
* Fix default values in image_processing_vivit.py
---------
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
|
2023-07-11 14:04:04 +01:00 |
|