transformers/tests
eustlb 2b85b6ce19
[Whisper] 🚨 Fix pipeline word timestamp: timestamp token is end of token time !!! (#36632)
* timestamp token is end of token time !!!

* ensure correct alignment between tokens and timestamp tokens

* ignore input tokens for DTW computation

* use num_frames to avoid token timestamp hallucinations

* token timestamps test updates !

* num_frames: deprecate and use attention_mask instead

* avoid breaking change

* fix the pipeline usage for chunk approach

* make style

* better logging

* better logging

* make style

* update tests with correct values
2025-06-27 12:51:43 +00:00
..
bettertransformer Use Python 3.9 syntax in tests (#37343) 2025-04-08 14:12:08 +02:00
deepspeed Remove script datasets in tests (#38940) 2025-06-25 14:31:20 +00:00
extended Add Optional to remaining types (#37808) 2025-04-28 14:20:45 +01:00
fixtures [tests] remove tests from libraries with deprecated support (flax, tensorflow_text, ...) (#39051) 2025-06-26 16:25:00 +01:00
fsdp Gaudi3 CI (#38790) 2025-06-23 10:56:51 +02:00
generation fix test_compare_unprocessed_logit_scores (#39053) 2025-06-26 18:36:56 +02:00
models [Whisper] 🚨 Fix pipeline word timestamp: timestamp token is end of token time !!! (#36632) 2025-06-27 12:51:43 +00:00
optimization [tests] remove TF tests (uses of require_tf) (#38944) 2025-06-25 17:29:10 +00:00
peft_integration FIX: Faulty PEFT tests (#37757) 2025-04-28 15:10:46 +02:00
pipelines [tests] remove tests from libraries with deprecated support (flax, tensorflow_text, ...) (#39051) 2025-06-26 16:25:00 +01:00
quantization fix a bunch of XPU UT failures on stock PyTorch 2.7 and 2.8 (#39069) 2025-06-27 14:01:53 +02:00
repo_utils Use HF papers (#38184) 2025-06-13 11:07:09 +00:00
sagemaker Deprecate TF + JAX (#38758) 2025-06-11 17:28:06 +01:00
tensor_parallel [TP] Change command in tests to python3 (#38555) 2025-06-03 11:03:33 +00:00
tokenization [tests] remove tests from libraries with deprecated support (flax, tensorflow_text, ...) (#39051) 2025-06-26 16:25:00 +01:00
trainer [tests] remove TF tests (uses of require_tf) (#38944) 2025-06-25 17:29:10 +00:00
utils [tests] remove tests from libraries with deprecated support (flax, tensorflow_text, ...) (#39051) 2025-06-26 16:25:00 +01:00
__init__.py GPU text generation: mMoved the encoded_prompt to correct device 2020-01-06 15:11:12 +01:00
causal_lm_tester.py Refactor DBRX tests to use CausalLMModelTest base classes (#38475) 2025-06-13 16:22:12 +01:00
test_backbone_common.py Use Python 3.9 syntax in tests (#37343) 2025-04-08 14:12:08 +02:00
test_configuration_common.py Update composition flag usage (#36263) 2025-04-09 11:48:49 +02:00
test_feature_extraction_common.py Use Python 3.9 syntax in tests (#37343) 2025-04-08 14:12:08 +02:00
test_image_processing_common.py Add Idefics2/3 and SmolVLM Fast image processors + improvements for fast image processors (#38157) 2025-06-23 14:17:25 +00:00
test_image_transforms.py [tests] remove tests from libraries with deprecated support (flax, tensorflow_text, ...) (#39051) 2025-06-26 16:25:00 +01:00
test_modeling_common.py fix t5gemma tests (#39052) 2025-06-26 18:48:14 +02:00
test_pipeline_mixin.py No more Tuple, List, Dict (#38797) 2025-06-17 19:37:18 +01:00
test_processing_common.py [video processors] support frame sampling within processors (#38105) 2025-06-12 09:34:30 +00:00
test_sequence_feature_extraction_common.py [tests] remove TF tests (uses of require_tf) (#38944) 2025-06-25 17:29:10 +00:00
test_tokenization_common.py [tests] remove tests from libraries with deprecated support (flax, tensorflow_text, ...) (#39051) 2025-06-26 16:25:00 +01:00
test_training_args.py Fix TrainingArguments.torch_empty_cache_steps post_init check (#36734) 2025-03-17 16:09:46 +01:00
test_video_processing_common.py [video processors] support frame sampling within processors (#38105) 2025-06-12 09:34:30 +00:00