amyeroberts
30409af6e1
Update InstructBLIP & Align values after rescale update ( #25209 )
...
* Update InstructBLIP values
Note: the tests are not independent. Running the test independentely produces different logits compared to running all the integration tests
* Update test values after rescale update
* Remove left over commented out code
* Revert to previous rescaling logic
* Update rescale tests
2023-08-03 11:01:10 +01:00
amyeroberts
1b35409768
Update rescale tests - cast to float after rescaling to reflect #25229 ( #25259 )
...
Rescale tests - cast to float after rescaling to reflect #25229
2023-08-02 11:29:55 +01:00
amyeroberts
05cda5df34
🚨 🚨 🚨 Fix rescale ViVit Efficientnet ( #25174 )
...
* Fix rescaling bug
* Add tests
* Update integration tests
* Fix up
* Update src/transformers/image_transforms.py
* Update test - new possible order in list
2023-07-28 19:52:51 +01:00
Jegor Kitškerkin
8a5e8a9c2a
Add ViViT ( #22518 )
...
* Add model
* Add ability to get classification head weights
* Add docs
* Add imports to __init__.py
* Run style
* Fix imports and add mdx doc
* Run style
* Fix copyright
* Fix config docstring
* Remove imports of ViViTLayer and load_tf_weights_in_vivit
* Remove FeatureExtractor and replace with ImageProcessor everywhere
* Remove ViViTForPreTraining from vivit.mdx
* Change ViViT -> Vivit everywhere
* Add model_doc to _toctree.yml
* Replace tuples with lists in arguments of VivitConfig
* Rename patch_size to tubelet_size in TubeletEmbeddings
* Fix checkpoint names
* Add tests
* Remove unused num_frames
* Fix imports for VivitImageProcessor
* Minor fixes
* Decrease number of frames in VivitModelTester from 32 to 16
* Decrease number of frames in VivitModelTester from 16 to 8
* Add initialization for pos embeddings
* Rename Vivit -> ViViT in some places
* Fix docstring and formatting
* Rename TubeletEmbeddings -> VivitTubeletEmbeddings
* Remove load_tf_weights_in_vivit
* Change checkpoint name
* Remove Vivit _TOKENIZER_FOR_DOC
* Fix
* Fix VivitTubeletEmbeddings and pass config object as parameter
* Use image_size and num_frames instead of video_size
* Change conversion script and fix differences with the orig implementation
* Fix docstrings
* Add attention head pruning
* Run style and fixup
* Fix tests
* Add ViViT to video_classification.mdx
* Save processor in conversion script
* Fix
* Add image processor test
* Run fixup and style
* Run fix-copies
* Update tests/models/vivit/test_modeling_vivit.py
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
* Update tests/models/vivit/test_modeling_vivit.py
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
* Update src/transformers/models/vivit/modeling_vivit.py
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
* Use PyAV instead of decord
* Add unittest.skip
* Run style
* Remove unneeded test
* Update docs/source/en/model_doc/vivit.mdx
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
* Update src/transformers/models/vivit/configuration_vivit.py
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
* Update src/transformers/models/vivit/modeling_vivit.py
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
* Update src/transformers/models/vivit/image_processing_vivit.py
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
* Update src/transformers/models/vivit/modeling_vivit.py
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
* Update src/transformers/models/vivit/modeling_vivit.py
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
* Update src/transformers/models/vivit/image_processing_vivit.py
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
* Update src/transformers/models/vivit/modeling_vivit.py
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
* Add model
* Add docs
* Run style
* Fix imports and add mdx doc
* Remove FeatureExtractor and replace with ImageProcessor everywhere
* Change ViViT -> Vivit everywhere
* Rename Vivit -> ViViT in some places
* Update src/transformers/models/vivit/image_processing_vivit.py
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
* Run make style
* Remove inputs save
* Fix image processor
* Fix
* Run `make style`
* Decrease parameters of VivitModelTester
* Decrease tubelet size
* Rename vivit.mdx
* Update src/transformers/models/vivit/image_processing_vivit.py
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
* Update src/transformers/models/vivit/image_processing_vivit.py
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
* Update src/transformers/models/vivit/image_processing_vivit.py
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
* Fix default values in image_processing_vivit.py
---------
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
2023-07-11 14:04:04 +01:00
