transformers/docs/source/en
Stas Bekman 71abd3ade1
[WIP] [doc] performance/scalability revamp (#15723)
* [doc] performance/scalability revamp

* link the new docs

* no :

* mixed precision

* work on the first doc

* expand the main doc

* Trigger CI

* style

* revamp single GPU training section

* work on training performance

* remove files not used anymore or will be added later

* final touches

* fix rebase

* Add hardware section to toctree

* fix toctree again

* Apply suggestions from code review

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* remove `fast_tokenizers` entry that was copied in rebase

* add warning about DP vs DDP

* remove todo

* Apply suggestions from code review

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* fix missing closure of codeblock

* Update docs/source/en/perf_train_gpu_many.mdx

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* sync with #16860

* update toc

Co-authored-by: leandro <leandro.vonwerra@spoud.io>
Co-authored-by: Leandro von Werra <lvwerra@users.noreply.github.com>
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
2022-05-16 13:36:41 +02:00
..
internal [WIP] Enable reproducibility for distributed trainings (#16907) 2022-05-11 09:37:13 -04:00
main_classes PyTorch FSDP integration in Trainer (#17136) 2022-05-09 20:40:56 +05:30
model_doc Update data2vec.mdx to include a Colab Notebook link (that shows fine-tuning) (#17194) 2022-05-12 10:22:00 -04:00
tasks Update audio examples with MInDS-14 (#16633) 2022-04-08 15:55:42 -05:00
_config.py Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
_toctree.yml [WIP] [doc] performance/scalability revamp (#15723) 2022-05-16 13:36:41 +02:00
accelerate.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
add_new_model.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
add_new_pipeline.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
autoclass_tutorial.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
benchmarks.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
bertology.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
big_models.mdx Make Trainer compatible with sharded checkpoints (#17053) 2022-05-03 09:55:10 -04:00
community.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
contributing.md Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
converting_tensorflow_models.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
create_a_model.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
custom_models.mdx Update custom_models.mdx (#16964) 2022-04-27 16:46:55 +02:00
debugging.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
fast_tokenizers.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
glossary.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
index.mdx Add OPT (#17088) 2022-05-12 12:24:35 +02:00
installation.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
migration.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
model_sharing.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
model_summary.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
multilingual.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
notebooks.md Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
pad_truncation.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
perf_hardware.mdx [WIP] [doc] performance/scalability revamp (#15723) 2022-05-16 13:36:41 +02:00
perf_train_gpu_many.mdx [WIP] [doc] performance/scalability revamp (#15723) 2022-05-16 13:36:41 +02:00
perf_train_gpu_one.mdx [WIP] [doc] performance/scalability revamp (#15723) 2022-05-16 13:36:41 +02:00
performance.mdx [WIP] [doc] performance/scalability revamp (#15723) 2022-05-16 13:36:41 +02:00
perplexity.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
philosophy.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
pipeline_tutorial.mdx 📝 open fresh PR for pipeline doctests (#17073) 2022-05-04 11:30:34 -05:00
pr_checks.mdx Add a check on config classes docstring checkpoints (#17012) 2022-04-30 10:40:46 +02:00
preprocessing.mdx Fixing the output of code examples in the preprocessing chapter (#17162) 2022-05-10 12:16:28 -04:00
quicktour.mdx Fix doc test quicktour dataset (#16929) 2022-04-25 16:26:59 +02:00
run_scripts.mdx Fix all docs for accelerate install directions (#17145) 2022-05-09 15:45:18 -04:00
sagemaker.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
serialization.mdx Fix quality and repo consistency 2022-05-09 11:14:36 -04:00
task_summary.mdx [Doctests] Correct task summary (#16644) 2022-04-11 14:59:35 +02:00
testing.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
tokenizer_summary.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
training.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
troubleshooting.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00