jeffhataws c59d71b282 Add AWS Neuron torchrun support (#20806) ... * Add XLA torchrun support * Clarify that currently DDP doesn't work with torch.distributed XLA backend yet * Enable DDP with torchrun and XLA (now available in PT-XLA 1.13) * Add check for AWS Neuron availability and AWS Neuron specific compiler flag * Change the new test's name to TestTrainerDistributedNeuronCore * Remove "assert" and replace raised exception * Remove compiler flag as it is optional. If needed, will be another PR. * Use TORCHELASTIC_RUN_ID to determine whether torchrun is used		2023-01-18 11:21:19 -05:00
..
benchmark	[Test refactor 1/5] Per-folder tests reorganization (#15725)	2022-02-23 15:46:28 -05:00
deepspeed	Fix tapas scatter (#20149)	2022-11-14 01:04:26 -05:00
extended	[bnb optim] fixing test (#21030)	2023-01-12 08:52:54 -08:00
fixtures	add a warning in SpmConverter for sentencepiece's model using the byte fallback feature (#16629)	2022-04-11 11:06:10 +02:00
generation	Add Epsilon- and Eta-Sampling (#21121)	2023-01-17 13:04:32 -05:00
mixed_int8	Add keep_in_fp32_modules support (#20683)	2022-12-13 11:59:57 +01:00
models	Adapt repository creation to latest hf_hub (#21158)	2023-01-18 11:14:00 -05:00
onnx	Add Onnx Config for PoolFormer (#20868)	2022-12-23 01:30:57 -05:00
optimization	[Test refactor 1/5] Per-folder tests reorganization (#15725)	2022-02-23 15:46:28 -05:00
pipelines	Adapt repository creation to latest hf_hub (#21158)	2023-01-18 11:14:00 -05:00
repo_utils	Repo utils test (#19696)	2022-10-18 13:47:36 -04:00
sagemaker	transformers-cli login => huggingface-cli login (#18490)	2022-08-06 09:42:55 +02:00
tokenization	fix train_new_from_iterator in the case of byte-level tokenizers (#17549)	2022-06-08 15:30:41 +02:00
trainer	Add AWS Neuron torchrun support (#20806)	2023-01-18 11:21:19 -05:00
utils	Fixing offline mode for pipeline (when inferring task). (#21113)	2023-01-17 15:24:40 +01:00
__init__.py	GPU text generation: mMoved the encoded_prompt to correct device	2020-01-06 15:11:12 +01:00
test_configuration_common.py	Add WhisperModel to transformers (#19166)	2022-10-05 22:28:31 +02:00
test_feature_extraction_common.py	[Vision] .to function for ImageProcessors (#20536)	2022-12-05 19:10:54 +01:00
test_image_transforms.py	Move convert_to_rgb to image_transforms module (#20784)	2022-12-15 18:47:04 +00:00
test_modeling_common.py	Fixed issue #21039 (#21062)	2023-01-12 10:03:13 +01:00
test_modeling_flax_common.py	Allow flax subfolder (#19902)	2022-10-26 18:33:23 +02:00
test_modeling_tf_common.py	Make test_save_pretrained_signatures slow test (#21105)	2023-01-18 10:43:05 +01:00
test_sequence_feature_extraction_common.py	Some tests misusing assertTrue for comparisons fix (#16771)	2022-04-19 14:44:08 +02:00
test_tokenization_common.py	🚨 🚨 🚨 Fix Issue 15003: SentencePiece Tokenizers Not Adding Special Tokens in convert_tokens_to_string (#15775)	2022-11-02 15:45:38 -04:00