Arthur 88832c01c8 [Whisper] Add conversion script for the tokenizer (#27338) ... * draft * updates * full conversion taken from `https://gist.github.com/xenova/a452a6474428de0182b17605a98631ee` * psuh * nits * updates * more nits * Add co author Co-authored-by: Joshua Lochner <admin@xenova.com> * fixup * cleanup * styling * add proper path * update * nits * don't push the exit * clean * update whisper doc * don't error out if tiktoken is not here * make sure we are BC with conversion * nit * Update docs/source/en/model_doc/whisper.md Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com> * merge and update * update markdwon * Co-authored-by: Sanchit Gandhi <93869735+sanchit-gandhi@users.noreply.github.com> --------- Co-authored-by: Joshua Lochner <admin@xenova.com> Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>		2023-11-07 15:07:55 +01:00
..
de	[i18n-DE] contribute chapter (#26481)	2023-10-02 09:56:40 -07:00
en	[Whisper] Add conversion script for the tokenizer (#27338)	2023-11-07 15:07:55 +01:00
es	[docs] fixed links with 404 (#27327)	2023-11-06 19:45:03 +00:00
fr	Fix typos (#25936)	2023-09-04 11:15:12 +01:00
hi	Hindi translation of pipeline_tutorial.md (#26837)	2023-10-25 11:21:49 -07:00
it	[docs] fixed links with 404 (#27327)	2023-11-06 19:45:03 +00:00
ja	[docs] fixed links with 404 (#27327)	2023-11-06 19:45:03 +00:00
ko	[docs] fixed links with 404 (#27327)	2023-11-06 19:45:03 +00:00
ms	Remove broken links to s-JoL/Open-Llama (#27164)	2023-10-31 10:17:54 +00:00
pt	[docs] fixed links with 404 (#27327)	2023-11-06 19:45:03 +00:00
te	Added Telugu [te] translations (#26828)	2023-10-20 15:27:55 -07:00
zh	[docs] fixed links with 404 (#27327)	2023-11-06 19:45:03 +00:00
_config.py	Adding evaluate to the list of libraries required in generated notebooks (#20850)	2022-12-21 14:04:08 +01:00