transformers/tests/trainer
Viktor Scherbakov 871598be55
Implemented safetensors checkpoints save/load for Trainer (#22498)
* implemented safetensors save/load

* remove duplicated file

* added tests

* more tests

* style fix

* fix tf tests

* change to list comprehension

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* review fixes + safe load for sharded checkpoint

* style fix

* remove rogue import

* remove partial to avoid undefined exception

* use naming alias instead of safetensors.torch

* fix safe sharding in tests

* grammar

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* update docs

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* update docs

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* minor corrections

* style

---------

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
2023-04-04 09:05:04 -04:00
..
__init__.py
test_data_collator.py handle numpy inputs in whole word mask data collator (#22032) 2023-03-10 10:50:29 -05:00
test_trainer_callback.py Apply ruff flake8-comprehensions (#21694) 2023-02-22 09:14:54 +01:00
test_trainer_distributed.py Update quality tooling for formatting (#21480) 2023-02-06 18:10:56 -05:00
test_trainer_seq2seq.py Reorganize file utils (#16264) 2022-03-23 10:26:33 -04:00
test_trainer_tpu.py
test_trainer_utils.py Apply ruff flake8-comprehensions (#21694) 2023-02-22 09:14:54 +01:00
test_trainer.py Implemented safetensors checkpoints save/load for Trainer (#22498) 2023-04-04 09:05:04 -04:00