transformers/docs/source/en/main_classes
Sourab Mangrulkar a761d6e9a0
Refactoring Trainer, adds save_only_model arg and simplifying FSDP integration (#27652)
* add code changes

1. Refactor FSDP
2. Add `--save_only_model` option: When checkpointing, whether to only save the model, or also the optimizer, scheduler & rng state.
3. Bump up the minimum `accelerate` version to `0.21.0`

* quality

* fix quality?

* Revert "fix quality?"

This reverts commit 149330a6ab.

* fix fsdp doc strings

* fix quality

* Update src/transformers/training_args.py

Co-authored-by: Zach Mueller <muellerzr@gmail.com>

* please fix the quality issue 😅

* Apply suggestions from code review

Co-authored-by: Benjamin Bossan <BenjaminBossan@users.noreply.github.com>

* address comment

* simplify conditional check as per the comment

* update documentation

---------

Co-authored-by: Zach Mueller <muellerzr@gmail.com>
Co-authored-by: Benjamin Bossan <BenjaminBossan@users.noreply.github.com>
2023-11-24 11:40:52 +05:30
..
agent.md [doc] Always call it Agents for consistency (#25958) 2023-09-05 12:27:20 +01:00
callback.md Adds dvclive callback (#27352) 2023-11-09 12:19:31 +00:00
configuration.md Migrate doc files to Markdown. (#24376) 2023-06-20 18:07:47 -04:00
data_collator.md Migrate doc files to Markdown. (#24376) 2023-06-20 18:07:47 -04:00
deepspeed.md Fix Typo: table in deepspeed.md (#26705) 2023-10-10 11:50:10 +02:00
feature_extractor.md Fixed typos (#26810) 2023-10-16 09:52:29 +02:00
image_processor.md Migrate doc files to Markdown. (#24376) 2023-06-20 18:07:47 -04:00
keras_callbacks.md Migrate doc files to Markdown. (#24376) 2023-06-20 18:07:47 -04:00
logging.md Warnings controlled by logger level (#26527) 2023-10-12 10:48:38 +02:00
model.md Fix typo 'submosules' (#24809) 2023-07-13 16:56:53 +01:00
onnx.md Migrate doc files to Markdown. (#24376) 2023-06-20 18:07:47 -04:00
optimizer_schedules.md Migrate doc files to Markdown. (#24376) 2023-06-20 18:07:47 -04:00
output.md Translating en/main_classes folder docs to Japanese 🇯🇵 (#26894) 2023-10-30 09:39:14 -07:00
pipelines.md Fixed typo in pipelines.md documentation (#27455) 2023-11-13 17:50:40 +00:00
processors.md [docs] fixed links with 404 (#27327) 2023-11-06 19:45:03 +00:00
quantization.md [docs] fixed links with 404 (#27327) 2023-11-06 19:45:03 +00:00
text_generation.md Migrate doc files to Markdown. (#24376) 2023-06-20 18:07:47 -04:00
tokenizer.md [PretrainedTokenizer] add some of the most important functions to the doc (#27313) 2023-11-06 15:11:00 +01:00
trainer.md Refactoring Trainer, adds save_only_model arg and simplifying FSDP integration (#27652) 2023-11-24 11:40:52 +05:30