Steven Liu
96be1b7f49
Update feature extractor docs ( #18324 )
...
As pointed out by @NielsRogge, a feature extractor is used to prepare inputs for a model with a single modality rather than multimodal models.
2022-07-27 15:32:57 -05:00
Sijun He
66336dc183
Add Visual Question Answering (VQA) pipeline ( #17286 )
...
* wip
* rebase
* all tests pass
* rebase
* ready for PR
* address comments
* fix styles
* add require_torch to pipeline test
* remove remote image to improve CI consistency
* address comments; fix tf/flax tests
* address comments; fix tf/flax tests
* fix tests; add alias
* repo consistency tests
* Update src/transformers/pipelines/visual_question_answering.py
Co-authored-by: NielsRogge <48327001+NielsRogge@users.noreply.github.com>
* address comments
* Update src/transformers/pipelines/visual_question_answering.py
Co-authored-by: NielsRogge <48327001+NielsRogge@users.noreply.github.com>
* merge
* Update src/transformers/models/auto/modeling_auto.py
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
* merge
Co-authored-by: Sijun He <sijunhe@Sijuns-MacBook-Pro.local>
Co-authored-by: NielsRogge <48327001+NielsRogge@users.noreply.github.com>
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
2022-06-13 07:49:44 -04:00
Sylvain Gugger
29080643eb
Mention in the doc we drop support for fairscale ( #17610 )
2022-06-09 12:20:39 -04:00
Sylvain Gugger
56f50590d5
Use Accelerate in from_pretrained for big model inference ( #17341 )
...
* Initial work
* More or less finished with first draft
* Update src/transformers/modeling_utils.py
Co-authored-by: Stas Bekman <stas00@users.noreply.github.com>
* Update src/transformers/modeling_utils.py
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
* Fix randomly initialized weights
* Update src/transformers/modeling_utils.py
Co-authored-by: Lysandre Debut <lysandre.debut@reseau.eseo.fr>
* Address review comments
* Rename DeepSpeed folder to temporarily fix the test issue?
* Revert to try if Accelerate fix works
* Use latest Accelerate release
* Quality and fixes
* Style
* Quality
* Add doc
* Test + fix
* More blocks
Co-authored-by: Stas Bekman <stas00@users.noreply.github.com>
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: Lysandre Debut <lysandre.debut@reseau.eseo.fr>
2022-05-23 14:32:21 -04:00
Patrick von Platen
5a9957358c
Add Wav2Vec2Conformer ( #16812 )
...
* save intermediate
* add wav2vec2 conformer
* add more code
* more
* first test passes
* make all checkpoints work
* update
* up
* more clean ups
* save clean-up
* save clean-up
* save more
* remove bogus
* finalize design conformer
* remove vision
* finish all tests
* more changes
* finish code
* add doc tests
* add slow tests
* fix autoconfig test
* up
* correct docstring
* up
* update
* fix
* Apply suggestions from code review
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
Co-authored-by: Anton Lozhkov <aglozhkov@gmail.com>
* Update docs/source/en/model_doc/wav2vec2-conformer.mdx
* upload
* save copied from
* correct configs
* fix model outputs
* add to docs
* fix imports
* finish
* finish code
* correct copied from
* correct again
* correct make fix
* improve make fix copies
* save
* correct fix copy from
* correct init structure
* correct
* fix import
* apply suggestions
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
Co-authored-by: Anton Lozhkov <aglozhkov@gmail.com>
2022-05-17 00:43:16 +02:00
Sander Land
053a80c606
logging documentation update ( #17174 )
...
* logging documentation
* style
Co-authored-by: Sander Land <sander@chatdesk.com>
2022-05-16 16:47:28 -04:00
Sourab Mangrulkar
05fc1766ff
PyTorch FSDP integration in Trainer ( #17136 )
...
* PyTorch FSDP integration in Trainer
* reformatting
make style and make quality are now compliant.
* Updating dependency check
* Trigger CI
Co-authored-by: Sylvain Gugger <Sylvain.gugger@gmail.com>
2022-05-09 20:40:56 +05:30
Steven Liu
cad61b6839
Fix link to example scripts ( #17103 )
2022-05-05 15:20:27 -05:00
Sylvain Gugger
a8fa2f91f4
Make Trainer compatible with sharded checkpoints ( #17053 )
...
* Make Trainer compatible with sharded checkpoints
* Add doc
2022-05-03 09:55:10 -04:00
Yang Ming
10dfa126b7
documentation: some minor clean up ( #16850 )
2022-04-26 16:56:08 -04:00
Sylvain Gugger
b9a768b3ff
Enable doc in Spanish ( #16518 )
...
* Reorganize doc for multilingual support
* Fix style
* Style
* Toc trees
* Adapt templates
2022-04-04 10:25:46 -04:00
