Arthur 015f8e110d [CodeLlama] Add support for CodeLlama (#25740) ... * add all * Revert "Delete .github directory" This reverts commit 9b0ff7b052e2b20b629a26fb13606b78a42944d1. * make conversion script backward compatible * fixup * more styling * copy to llama changes * fix repo consistency * nits * document correct classes * updates * more fixes * nits * update auto mappings * add readmes * smallupdates * llama-code replace with llama_code * make fixup * updates to the testsing suite * fix fast nits * more small fixes * fix decode * fix template processing * properly reset the normalizer * nits processor * tokenization tests pass * styling * last tests * additional nits * one test is left * nits Co-authored-by faabian <faabian@users.noreply.github.com> * update failing test * fixup * remove decode infilling users should handle it on their onw after generation, padding can be a problem * update * make test slow and more meaningfull * fixup * doc update * fixup * Apply suggestions from code review * add kwargs doc * tokenizer requires `requires_backend` * type requires_backends * CodeLlama instead of LlamaCode * more name cahnges * nits * make doctests happy * small pipeline nits * last nit * Apply suggestions from code review Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com> * update * add codellama to toctree --------- Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>		2023-08-25 18:57:40 +02:00
..
benchmark
bettertransformer
deepspeed	🚨🚨🚨 [Refactor] Move third-party related utility files into integrations/ folder 🚨🚨🚨 (#25599)	2023-08-25 17:13:34 +02:00
extended
fixtures
generation	Generate: general test for decoder-only generation from inputs_embeds (#25687)	2023-08-23 19:17:01 +01:00
models	[CodeLlama] Add support for CodeLlama (#25740)	2023-08-25 18:57:40 +02:00
optimization
peft_integration	[PEFT] Fix PeftConfig save pretrained when calling add_adapter (#25738)	2023-08-25 08:19:11 +02:00
pipelines	[ASR Pipe Test] Fix CTC timestamps error message (#25727)	2023-08-24 17:58:37 +01:00
quantization	🚨🚨🚨 [Refactor] Move third-party related utility files into integrations/ folder 🚨🚨🚨 (#25599)	2023-08-25 17:13:34 +02:00
repo_utils	Document check copies (#25291)	2023-08-04 14:56:29 +02:00
sagemaker
tokenization	[ PreTrainedTokenizerFast] Keep properties from fast tokenizer (#25053)	2023-07-25 18:45:01 +02:00
tools	Add support for for loops in python interpreter (#24429)	2023-06-26 09:58:14 -04:00
trainer	Make training args fully immutable (#25435)	2023-08-15 11:47:47 -04:00
utils	Skip broken tests	2023-08-24 01:48:53 -04:00
__init__.py
test_backbone_common.py
test_configuration_common.py	Deal with nested configs better in base class (#25237)	2023-08-04 14:56:09 +02:00
test_configuration_utils.py	Deal with nested configs better in base class (#25237)	2023-08-04 14:56:09 +02:00
test_feature_extraction_common.py
test_feature_extraction_utils.py
test_image_processing_common.py	Input data format (#25464)	2023-08-16 17:45:02 +01:00
test_image_processing_utils.py	Run hub tests (#24807)	2023-07-13 15:25:45 -04:00
test_image_transforms.py	Add input_data_format argument, image transforms (#25462)	2023-08-11 15:09:31 +01:00
test_modeling_common.py	[resize_embedding] Introduce pad_to_multiple_of and guidance (#25088)	2023-08-17 17:00:32 +02:00
test_modeling_flax_common.py
test_modeling_flax_utils.py
test_modeling_tf_common.py	Skip test_onnx_runtime_optimize for now (#25560)	2023-08-17 11:23:16 +02:00
test_modeling_tf_utils.py
test_modeling_utils.py	Generate: Load generation config when device_map is passed (#25413)	2023-08-10 10:54:26 +01:00
test_pipeline_mixin.py	Add Text-To-Speech pipeline (#24952)	2023-08-17 17:34:47 +01:00
test_sequence_feature_extraction_common.py
test_tokenization_common.py	[split_special_tokens] Add support for split_special_tokens argument to encode (#25081)	2023-08-18 13:26:27 +02:00
test_tokenization_utils.py