transformers/docs/source
Sylvain Gugger 56f50590d5
Use Accelerate in from_pretrained for big model inference (#17341)
* Initial work

* More or less finished with first draft

* Update src/transformers/modeling_utils.py

Co-authored-by: Stas Bekman <stas00@users.noreply.github.com>

* Update src/transformers/modeling_utils.py

Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

* Fix randomly initialized weights

* Update src/transformers/modeling_utils.py

Co-authored-by: Lysandre Debut <lysandre.debut@reseau.eseo.fr>

* Address review comments

* Rename DeepSpeed folder to temporarily fix the test issue?

* Revert to try if Accelerate fix works

* Use latest Accelerate release

* Quality and fixes

* Style

* Quality

* Add doc

* Test + fix

* More blocks

Co-authored-by: Stas Bekman <stas00@users.noreply.github.com>
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: Lysandre Debut <lysandre.debut@reseau.eseo.fr>
2022-05-23 14:32:21 -04:00
..
en Use Accelerate in from_pretrained for big model inference (#17341) 2022-05-23 14:32:21 -04:00
es Guide to create custom models in Spanish (#17158) 2022-05-13 16:19:29 -04:00
pt [ fast_tokenizers.mdx ] - Added translation to portuguese to tutorial (#17076) 2022-05-13 16:18:14 -04:00
_config.py Use doc builder styler (#16412) 2022-03-28 07:45:18 -04:00