eustlb 54aae121eb [Whisper] Fix whisper tokenizer (#34537) ... * handle single timestamp ending * include last timestamp token * handle single timestamp ending * avoid floating points arithm limitations * ensure float64 operations * new test * make fixup * make copies * handle edge case double tokens ending with different tokens * handle single timestamp ending * make fixup * handle conditioning on prev segments * fix * Update src/transformers/models/whisper/generation_whisper.py Co-authored-by: Yoach Lacombe <52246514+ylacombe@users.noreply.github.com> * [run-slow] whisper * don't call item() to avoid unnecessary sync * fix --------- Co-authored-by: Yoach Lacombe <52246514+ylacombe@users.noreply.github.com> Co-authored-by: Eustache Le Bihan <eustlb@users.noreply.huggingface.co>		2024-12-05 13:46:29 +01:00
..
__init__.py
test_feature_extraction_whisper.py	Remove trust_remote_code when loading Libri Dummy (#31748)	2024-07-23 14:54:38 +08:00
test_modeling_flax_whisper.py	Forbid PretrainedConfig from saving generate parameters; Update deprecations in generate-related code 🧹 (#32659)	2024-08-23 11:12:53 +01:00
test_modeling_tf_whisper.py	Generation tests: update imagegpt input name, remove unused functions (#33663)	2024-09-24 16:40:48 +01:00
test_modeling_whisper.py	[Whisper] Fix whisper tokenizer (#34537)	2024-12-05 13:46:29 +01:00
test_processor_whisper.py	feat: Whisper prompting (#22496)	2023-05-19 09:33:11 +01:00
test_tokenization_whisper.py	Fix flax whisper tokenizer bug (#33151)	2024-09-12 12:21:59 +01:00