st81 8d6b509611 Add token type ids to CodeGenTokenizer (#29265) ... * Add create token type ids to CodeGenTokenizer * Fix inconsistent length of token type ids * Format source codes * Fix inconsistent order of methods * Update docstring * add test_tokenizer_integration test * Format source codes * Add `copied from` comment to CodeGenTokenizerFast * Add doc of create_token_type_ids_from_sequences * Make return_token_type_ids False by default * Make test_tokenizer_integration as slow test * Add return_token_type_ids to tokenizer init arg * Add test for tokenizer's init return_token_type_ids * Format source codes		2024-04-17 12:19:18 +02:00
..
benchmark	[Test refactor 1/5] Per-folder tests reorganization (#15725)	2022-02-23 15:46:28 -05:00
bettertransformer	Fixed malapropism error (#26660)	2023-10-09 11:04:57 +02:00
deepspeed	Fix failing DeepSpeed model zoo tests (#30112)	2024-04-09 12:01:47 +05:30
extended	[tests] make test_trainer_log_level_replica to run on accelerators with more than 2 devices (#29609)	2024-03-13 17:44:35 +00:00
fixtures	Implementation of SuperPoint and AutoModelForKeypointDetection (#28966)	2024-03-19 14:43:02 +00:00
fsdp	Add support for FSDP+QLoRA and DeepSpeed ZeRO3+QLoRA (#29587)	2024-03-13 22:03:02 +05:30
generation	Fix length related warnings in speculative decoding (#29585)	2024-04-10 12:45:07 +05:00
models	Add token type ids to CodeGenTokenizer (#29265)	2024-04-17 12:19:18 +02:00
optimization	Make schedulers picklable by making lr_lambda fns global (#21768)	2023-03-02 12:08:43 -05:00
peft_integration	FIX [CI]: Fix failing tests for peft integration (#29330)	2024-02-29 03:56:16 +01:00
pipelines	Fix Fatal Python error: Bus error in ZeroShotAudioClassificationPipelineTests (#30283)	2024-04-17 11:47:30 +02:00
quantization	FIX / AWQ: Fix failing exllama test (#30288)	2024-04-17 11:26:35 +02:00
repo_utils	Allow # Ignore copy (#27328)	2023-12-07 10:00:08 +01:00
sagemaker	Update all references to canonical models (#29001)	2024-02-16 08:16:58 +01:00
tokenization	Remove static pretrained maps from the library's internals (#29112)	2024-03-25 10:33:38 +01:00
tools	Add support for for loops in python interpreter (#24429)	2023-06-26 09:58:14 -04:00
trainer	Raise relevent err when wrong type is passed in as the accelerator_config (#29997)	2024-04-16 11:21:24 -04:00
utils	Allow for str versions of dicts based on typing (#30227)	2024-04-16 08:15:09 -04:00
__init__.py	GPU text generation: mMoved the encoded_prompt to correct device	2020-01-06 15:11:12 +01:00
test_backbone_common.py	Align backbone stage selection with out_indices & out_features (#27606)	2023-12-20 18:33:17 +00:00
test_cache_utils.py	Generate: add tests for caches with pad_to_multiple_of (#29462)	2024-03-06 10:57:04 +00:00
test_configuration_common.py	[ PretrainedConfig] Improve messaging (#27438)	2023-11-15 14:10:39 +01:00
test_configuration_utils.py	[tests] remove deprecated tests for model loading (#29450)	2024-03-15 14:18:41 +00:00
test_feature_extraction_common.py	Split common test from core tests (#24284)	2023-06-15 07:30:24 -04:00
test_feature_extraction_utils.py	[tests] remove deprecated tests for model loading (#29450)	2024-03-15 14:18:41 +00:00
test_image_processing_common.py	Raise unused kwargs image processor (#29063)	2024-02-20 16:20:20 +01:00
test_image_processing_utils.py	[tests] remove deprecated tests for model loading (#29450)	2024-03-15 14:18:41 +00:00
test_image_transforms.py	Normalize floating point cast (#27249)	2023-11-10 15:35:27 +00:00
test_modeling_common.py	Fix SDPA sliding window compatibility (#30127)	2024-04-17 17:21:26 +08:00
test_modeling_flax_common.py	fix: Replace deprecated assertEquals with assertEqual (#30241)	2024-04-15 09:36:06 +01:00
test_modeling_flax_utils.py	Enable safetensors conversion from PyTorch to other frameworks without the torch requirement (#27599)	2024-01-23 10:28:23 +01:00
test_modeling_tf_common.py	Add tf_keras imports to prepare for Keras 3 (#28588)	2024-01-30 17:26:36 +00:00
test_modeling_tf_utils.py	Cast bfloat16 to float32 for Numpy conversions (#29755)	2024-03-21 14:04:11 +00:00
test_modeling_utils.py	[tests] make 2 tests device-agnostic (#30008)	2024-04-10 14:46:39 +02:00
test_pipeline_mixin.py	Image Feature Extraction pipeline (#28216)	2024-02-05 14:50:07 +00:00
test_processing_common.py	Don't save processor_config.json if a processor has no extra attribute (#28584)	2024-01-19 09:59:14 +00:00
test_sequence_feature_extraction_common.py	Fix typo (#25966)	2023-09-05 10:12:25 +02:00
test_tokenization_common.py	fix: Replace deprecated assertEquals with assertEqual (#30241)	2024-04-15 09:36:06 +01:00
test_tokenization_utils.py	[tests] remove deprecated tests for model loading (#29450)	2024-03-15 14:18:41 +00:00