Sanchit Gandhi 06d488061f [Whisper Tokenizer] Make more user-friendly (#19921) ... * [Whisper Tokenizer] Make more user-friendly * use property * make indexing rigorous * small clean-up * tests * skip seq2seq tests * remove multilingual arg * reorder args * collapse to one function Co-authored-by: ArthurZucker <arthur@huggingface.co> * option to override attributes Co-authored-by: ArthurZucker <arthur@huggingface.co> * add to docs * Apply suggestions from code review Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com> * make comment more clear Co-authored-by: sgugger <sylvain@huggingface.co> * don't add special tokens in get_decoder_prompt_ids * add test for set_prefix_tokens Co-authored-by: ArthurZucker <arthur@huggingface.co> Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com> Co-authored-by: sgugger <sylvain@huggingface.co>		2022-11-03 14:22:40 +00:00
..
__init__.py	Add WhisperModel to transformers (#19166)	2022-10-05 22:28:31 +02:00
test_feature_extraction_whisper.py	[Whisper] Don't return attention mask in feat extractor (#19521)	2022-10-14 14:36:03 +01:00
test_modeling_tf_whisper.py	Run some TF Whisper tests in subprocesses to avoid GPU OOM (#19772)	2022-10-21 21:59:18 +02:00
test_modeling_whisper.py	fix tests (#19670)	2022-10-18 06:45:48 +02:00
test_processor_whisper.py	Add WhisperModel to transformers (#19166)	2022-10-05 22:28:31 +02:00
test_tokenization_whisper.py	[Whisper Tokenizer] Make more user-friendly (#19921)	2022-11-03 14:22:40 +00:00