transformers/tests/trainer
jeffhataws c59d71b282
Add AWS Neuron torchrun support (#20806)
* Add XLA torchrun support

* Clarify that currently DDP doesn't work with torch.distributed XLA backend yet

* Enable DDP with torchrun and XLA (now available in PT-XLA 1.13)

* Add check for AWS Neuron availability and AWS Neuron specific compiler flag

* Change the new test's name to TestTrainerDistributedNeuronCore

* Remove "assert" and replace raised exception

* Remove compiler flag as it is optional. If needed, will be another PR.

* Use TORCHELASTIC_RUN_ID to determine whether torchrun is used
2023-01-18 11:21:19 -05:00
..
__init__.py [Test refactor 1/5] Per-folder tests reorganization (#15725) 2022-02-23 15:46:28 -05:00
test_data_collator.py Data collator for token classification pads labels column when receives pytorch tensors (#20244) 2022-11-16 12:18:46 -05:00
test_trainer_callback.py Make predict() close progress bars after finishing (#17952) (#18078) 2022-07-08 16:44:24 -04:00
test_trainer_distributed.py Add AWS Neuron torchrun support (#20806) 2023-01-18 11:21:19 -05:00
test_trainer_seq2seq.py Reorganize file utils (#16264) 2022-03-23 10:26:33 -04:00
test_trainer_tpu.py [Test refactor 1/5] Per-folder tests reorganization (#15725) 2022-02-23 15:46:28 -05:00
test_trainer_utils.py Ensure tensors are at least 1d for pad and concat (#17179) 2022-05-11 13:19:08 -04:00
test_trainer.py Adapt repository creation to latest hf_hub (#21158) 2023-01-18 11:14:00 -05:00