Marc Sun 6cc4dfe3f1 Fix the initialization of the cache when we have multi gpu (#33303) ... * init cache multi-gpu * Update src/transformers/generation/utils.py Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com> * switch to execution device map * naming more consistant * fix * mutually exclusive device * added an integration example * remove useless check * suggestion from joao + typing * fix couple of typo and add test * revert check --------- Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com>		2024-09-13 15:06:08 +02:00
..
__init__.py
test_beam_constraints.py	Generate: move generation_*.py src files into generation/*.py (#20096)	2022-11-09 15:34:08 +00:00
test_beam_search.py	Time to Say Goodbye, torch 1.7 and 1.8 (#22291)	2023-03-21 19:22:01 +01:00
test_configuration_utils.py	Generate: throw warning when return_dict_in_generate is False but should be True (#33146)	2024-08-31 10:47:08 +01:00
test_flax_logits_process.py	Adding FlaxNoRepeatNGramLogitsProcessor (#29677)	2024-04-02 11:39:33 +02:00
test_flax_utils.py	Add support for beam search's num_return_sequencs flag in flax (#23082)	2023-05-03 10:50:34 -04:00
test_framework_agnostic.py	Generation: fix handling of special tokens (#31254)	2024-06-06 15:21:32 +05:00
test_logits_process.py	Pass device in Logits Processor's init (#29804)	2024-06-04 10:19:19 +05:00
test_stopping_criteria.py	Dynamic number of speculative tokens in order to accelerate speculative decoding (#33258)	2024-09-11 14:22:28 +02:00
test_streamers.py	Update all references to canonical models (#29001)	2024-02-16 08:16:58 +01:00
test_tf_logits_process.py	fix: multilingual midel convert to tflite get wrong token (#32079)	2024-08-27 11:44:09 +02:00
test_tf_utils.py	Revert workaround for TF safetensors loading (#30128)	2024-04-09 11:04:18 +01:00
test_utils.py	Fix the initialization of the cache when we have multi gpu (#33303)	2024-09-13 15:06:08 +02:00