transformers/docs/source
Sanchit Gandhi 06d488061f
[Whisper Tokenizer] Make more user-friendly (#19921)
* [Whisper Tokenizer] Make more user-friendly

* use property

* make indexing rigorous

* small clean-up

* tests

* skip seq2seq tests

* remove multilingual arg

* reorder args

* collapse to one function

Co-authored-by: ArthurZucker <arthur@huggingface.co>

* option to override attributes

Co-authored-by: ArthurZucker <arthur@huggingface.co>

* add to docs

* Apply suggestions from code review

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* make comment more clear

Co-authored-by: sgugger <sylvain@huggingface.co>

* don't add special tokens in get_decoder_prompt_ids

* add test for set_prefix_tokens

Co-authored-by: ArthurZucker <arthur@huggingface.co>
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
Co-authored-by: sgugger <sylvain@huggingface.co>
2022-11-03 14:22:40 +00:00
..
de german training, accelerate and model sharing (#19171) 2022-09-23 14:52:09 -04:00
en [Whisper Tokenizer] Make more user-friendly (#19921) 2022-11-03 14:22:40 +00:00
es Spanish translation of multiple_choice.mdx, question_answering.mdx. (#19821) 2022-10-24 20:11:34 -04:00
it Tranformers documentation translation to Italian #17459 (#19988) 2022-10-31 13:19:15 -04:00
pt Added translation of serialization.mdx to Portuguese Issue #16824 (#19869) 2022-10-25 09:34:28 -04:00
_config.py Use doc builder styler (#16412) 2022-03-28 07:45:18 -04:00