NielsRogge
|
d151a8c550
|
Add BiT + ViT hybrid (#20550)
* First draft
* More improvements
* Add backbone, first draft of ViT hybrid
* Add AutoBackbone
* More improvements
* Fix bug
* More improvements
* More improvements
* Convert ViT-hybrid
* More improvements
* add patch bit
* Fix style
* Improve code
* cleaned v1
* more cleaning
* more refactoring
* Improve models, add tests
* Add docs and tests
* Make more tests pass
* Improve default backbone config
* Update model_type
* Fix more tests
* Add more copied from statements
* More improvements
* Add push to hub to conversion scripts
* clean
* more cleanup
* clean
* replace to
* fix
* Update src/transformers/models/bit/configuration_bit.py
Co-authored-by: NielsRogge <48327001+NielsRogge@users.noreply.github.com>
* fix base model prefix
* more cleaning
* get rid of stem
* clean
* replace flag
* Update src/transformers/models/bit/configuration_bit.py
Co-authored-by: NielsRogge <48327001+NielsRogge@users.noreply.github.com>
* Update src/transformers/models/bit/configuration_bit.py
Co-authored-by: NielsRogge <48327001+NielsRogge@users.noreply.github.com>
* add check
* another check
* fix for hybrid vit
* final fix
* update config
* fix class name
* fix `make fix-copies`
* remove `use_activation`
* Update src/transformers/models/bit/configuration_bit.py
* rm unneeded file
* Add BiT image processor
* rm unneeded file
* add doc
* Add image processor to conversion script
* Add ViTHybrid image processor
* Add resources
* Move bit to correct position
* Fix auto mapping
* Rename hybrid to Hybrid
* Fix name in toctree
* Fix READMEs'
* Improve config
* Simplify GroupNormActivation layer
* fix test + make style
* Improve config
* Apply suggestions from code review
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
* remove comment
* remove comment
* replace
* replace
* remove all conv_layer
* refactor norm_layer
* revert x
* add copied from
* last changes + integration tests
* make fixup
* Apply suggestions from code review
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
* fix name
* fix message
* remove assert and refactor
* refactor + make fixup
* refactor - add + sfety checker
* fix docstring + checkpoint names
* fix merge issues
* fix function name
* fix copies
* Apply suggestions from code review
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
* fix model checkpoint
* fix doctest output
* vit name on doc
* fix name on doc
* fix small nits
* fixed integration tests
* final changes - slow tests pass
Co-authored-by: Niels Rogge <nielsrogge@Nielss-MacBook-Pro.local>
Co-authored-by: younesbelkada <younesbelkada@gmail.com>
Co-authored-by: Younes Belkada <49240599+younesbelkada@users.noreply.github.com>
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
|
2022-12-07 11:03:39 +01:00 |
|