eustlb da334bcfa8 [Whisper] 🚨 Fix whisper decoding 🚨 (#34135) ... * do not remove decoder_input_ids for the first segment * do not remove eos token in generate_with_fallback * when removing padding tokens, do not remove eos token * remove eos token in generate (and not in generate_with_fallback!) * reconciliate short-from/ long-form behavior * correct avg_logprobs calculation * handle eos token in segments * handle decoder_input_ids and eos token in _prepare_decoder_input_ids * fix incorrect time precision * always remove eos token * always remove decoder_input_ids * no need to handle decoder_inputs_ids and eos token * no need to remove decoder_input_ids * no need to handle eos token * fix num_beams in _retrieve_logit_processors * remove todo unconsistency * no need to add eos token * last_timestamp_pos should indeed be timestamp token pos * patch generate to enable compatibility with GenerationTesterMixin tests * adapt test_generate_continue_from_past_key_values * adapt test_prompt_lookup_decoding_matches_greedy_search * adapt generic GenerationMixin tests to whisper's generate * fix speculative decoding * fix * [run-slow] whisper * change HF_HUB_TOKEN for require_read_token * [run-slow] whisper * prioritize kwargs over generation_config * remove unnecessary args * [run-slow] whisper * update tests * [run-slow] whisper * add comment * update test * [run-slow] whisper * update test + revert require_read_token * docstring updates * revert tokenizer decode args change * do not use a patch + docstring updates * [run-slow] whisper * make * [run-slow] whisper * add a flag to force unique call to generate * test update * [run-slow] whisper * add force_unique_generate_call arg * do not use a patch * correct the timestamps for the pad tokens * docstring update * docstring update * docstring update * upodate TF tests * add require_read_token * [run-slow] whisper * test reset dynamo * [run-slow] whisper * fix * [run-slow] whisper * avoid iterating twice on current_segments * [run-slow] whisper * [run-slow] whisper --------- Co-authored-by: Eustache Le Bihan <eustlb@users.noreply.huggingface.co> Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>		2024-12-18 14:13:21 +01:00
..
__init__.py	Add WhisperModel to transformers (#19166)	2022-10-05 22:28:31 +02:00
test_feature_extraction_whisper.py	[tests] fix "Tester object has no attribute '_testMethodName'" (#34910)	2024-12-13 14:33:45 +01:00
test_modeling_flax_whisper.py	Forbid PretrainedConfig from saving generate parameters; Update deprecations in generate-related code 🧹 (#32659)	2024-08-23 11:12:53 +01:00
test_modeling_tf_whisper.py	[Whisper] 🚨 Fix whisper decoding 🚨 (#34135)	2024-12-18 14:13:21 +01:00
test_modeling_whisper.py	[Whisper] 🚨 Fix whisper decoding 🚨 (#34135)	2024-12-18 14:13:21 +01:00
test_processor_whisper.py	feat: Whisper prompting (#22496)	2023-05-19 09:33:11 +01:00
test_tokenization_whisper.py	Fix flax whisper tokenizer bug (#33151)	2024-09-12 12:21:59 +01:00