transformers/tests
amyeroberts ed115b3473
Normalize floating point cast (#27249)
* Normalize image - cast input images to float32.

This is done if the input image isn't of floating type. Issues can occur when do_rescale=False is set in an image processor. When this happens, the image passed to the call is of type uint8 becuase of the type casting that happens in resize because of the PIL image library. As the mean and std values are cast to match the image dtype, this can cause NaNs and infs to appear in the normalized image, as the floating values being used to divide the image are now set to 0.

The reason the mean and std values are cast is because previously they were set as float32 by default. However, if the input image was of type float16, the normalization would result in the image being upcast to float32 too.

* Add tests

* Remove float32 cast
2023-11-10 15:35:27 +00:00
..
benchmark [Test refactor 1/5] Per-folder tests reorganization (#15725) 2022-02-23 15:46:28 -05:00
bettertransformer Fixed malapropism error (#26660) 2023-10-09 11:04:57 +02:00
deepspeed device-agnostic deepspeed testing (#27342) 2023-11-09 12:34:13 +01:00
extended Device agnostic trainer testing (#27131) 2023-10-30 18:16:40 +00:00
fixtures [WIP] add SpeechT5 model (#18922) 2023-02-03 12:43:46 -05:00
fsdp device agnostic fsdp testing (#27120) 2023-11-01 07:17:06 +01:00
generation Generate: skip tests on unsupported models instead of passing (#27265) 2023-11-07 12:08:28 +00:00
models Add Phi-1 and Phi-1_5 (#26170) 2023-11-10 15:28:30 +00:00
optimization Make schedulers picklable by making lr_lambda fns global (#21768) 2023-03-02 12:08:43 -05:00
peft_integration [PEFT / Tests ] Fix peft integration failing tests (#27258) 2023-11-03 12:23:02 +01:00
pipelines Fix RequestCounter to make it more future-proof (#27406) 2023-11-09 18:53:26 +01:00
quantization [Quantization] Add str to enum conversion for AWQ (#27320) 2023-11-10 13:45:00 +01:00
repo_utils Docstring check (#26052) 2023-10-04 15:13:37 +02:00
sagemaker Add many missing spaces in adjacent strings (#26751) 2023-10-12 10:28:40 +02:00
tokenization [Tokenizer] Fix slow and fast serialization (#26570) 2023-10-18 16:30:53 +02:00
tools Add support for for loops in python interpreter (#24429) 2023-06-26 09:58:14 -04:00
trainer enable memory tracker metrics for npu (#27280) 2023-11-06 13:44:21 +00:00
utils Safetensors serialization by default (#27064) 2023-10-31 19:16:49 +01:00
__init__.py
test_backbone_common.py [AutoBackbone] Add test (#26094) 2023-09-18 23:47:54 +02:00
test_configuration_common.py Deal with nested configs better in base class (#25237) 2023-08-04 14:56:09 +02:00
test_configuration_utils.py Deal with nested configs better in base class (#25237) 2023-08-04 14:56:09 +02:00
test_feature_extraction_common.py Split common test from core tests (#24284) 2023-06-15 07:30:24 -04:00
test_feature_extraction_utils.py Split common test from core tests (#24284) 2023-06-15 07:30:24 -04:00
test_image_processing_common.py Input data format (#25464) 2023-08-16 17:45:02 +01:00
test_image_processing_utils.py Run hub tests (#24807) 2023-07-13 15:25:45 -04:00
test_image_transforms.py Normalize floating point cast (#27249) 2023-11-10 15:35:27 +00:00
test_modeling_common.py Fix safetensors failing tests (#27231) 2023-11-02 15:03:09 +01:00
test_modeling_flax_common.py Split common test from core tests (#24284) 2023-06-15 07:30:24 -04:00
test_modeling_flax_utils.py Safetensors serialization by default (#27064) 2023-10-31 19:16:49 +01:00
test_modeling_tf_common.py Skip test_onnx_runtime_optimize for now (#25560) 2023-08-17 11:23:16 +02:00
test_modeling_tf_utils.py Safetensors serialization by default (#27064) 2023-10-31 19:16:49 +01:00
test_modeling_utils.py [AttentionMaskConverter] ]Fix-mask-inf (#27114) 2023-11-10 15:22:43 +01:00
test_pipeline_mixin.py Shorten the conversation tests for speed + fixing position overflows (#26960) 2023-10-31 14:20:04 +00:00
test_sequence_feature_extraction_common.py Fix typo (#25966) 2023-09-05 10:12:25 +02:00
test_tokenization_common.py [Tokenizer] Fix slow and fast serialization (#26570) 2023-10-18 16:30:53 +02:00
test_tokenization_utils.py Split common test from core tests (#24284) 2023-06-15 07:30:24 -04:00