st81 8d6b509611 Add token type ids to CodeGenTokenizer (#29265) ... * Add create token type ids to CodeGenTokenizer * Fix inconsistent length of token type ids * Format source codes * Fix inconsistent order of methods * Update docstring * add test_tokenizer_integration test * Format source codes * Add `copied from` comment to CodeGenTokenizerFast * Add doc of create_token_type_ids_from_sequences * Make return_token_type_ids False by default * Make test_tokenizer_integration as slow test * Add return_token_type_ids to tokenizer init arg * Add test for tokenizer's init return_token_type_ids * Format source codes		2024-04-17 12:19:18 +02:00
..
de	add push_to_hub to pipeline (#29172)	2024-04-16 15:34:04 +01:00
en	Add token type ids to CodeGenTokenizer (#29265)	2024-04-17 12:19:18 +02:00
es	add push_to_hub to pipeline (#29172)	2024-04-16 15:34:04 +01:00
fr	[#29174] ImportError Fix: Trainer with PyTorch requires accelerate>=0.20.1 Fix (#29888)	2024-04-08 14:21:16 +01:00
hi	More fixes for doctest (#30265)	2024-04-16 11:58:55 +02:00
it	add push_to_hub to pipeline (#29172)	2024-04-16 15:34:04 +01:00
ja	Configuring Translation Pipelines documents update #27753 (#29986)	2024-04-17 11:27:49 +02:00
ko	Configuring Translation Pipelines documents update #27753 (#29986)	2024-04-17 11:27:49 +02:00
ms	[Docs] Add missing language options and fix broken links (#28852)	2024-02-06 12:01:01 -08:00
pt	[#29174] ImportError Fix: Trainer with PyTorch requires accelerate>=0.20.1 Fix (#29888)	2024-04-08 14:21:16 +01:00
te	[#29174] ImportError Fix: Trainer with PyTorch requires accelerate>=0.20.1 Fix (#29888)	2024-04-08 14:21:16 +01:00
tr	Translate index.md to Turkish (#27093)	2023-11-08 08:35:20 -05:00
zh	More fixes for doctest (#30265)	2024-04-16 11:58:55 +02:00
_config.py	[#29174] ImportError Fix: Trainer with PyTorch requires accelerate>=0.20.1 Fix (#29888)	2024-04-08 14:21:16 +01:00