4 Commits

Author	SHA1	Message	Date
Stas Bekman	29dfb2dbb1	[doc] performance and parallelism updates (#14391) ... * [doc] performance and parallelism doc update * improve * improve	2021-11-14 17:19:15 -08:00
Sylvain Gugger	27d4639779	Make gradient_checkpointing a training argument (#13657) ... * Make gradient_checkpointing a training argument * Update src/transformers/modeling_utils.py Co-authored-by: Stas Bekman <stas00@users.noreply.github.com> * Update src/transformers/configuration_utils.py Co-authored-by: Stas Bekman <stas00@users.noreply.github.com> * Fix tests * Style * document Gradient Checkpointing as a performance feature * Small rename * PoC for not using the config * Adapt BC to new PoC * Forgot to save * Rollout changes to all other models * Fix typo Co-authored-by: Stas Bekman <stas00@users.noreply.github.com> Co-authored-by: Stas Bekman <stas@stason.org>	2021-09-22 07:51:38 -04:00
Stas Bekman	31cfcbd3e2	[doc] performance: batch sizes (#12725)	2021-07-15 09:39:34 -07:00
Stas Bekman	bfd5da8e28	[docs] performance (#12258) ... * initial performance document * Apply suggestions from code review Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com> Co-authored-by: Lysandre Debut <lysandre@huggingface.co> * rewrites based on suggestions * 8x multiple is for AMP only * add contribute section Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com> Co-authored-by: Lysandre Debut <lysandre@huggingface.co>	2021-06-22 15:34:19 -07:00