riaz.somc/transformers
1
0
Fork 0
mirror of https://github.com/huggingface/transformers.git synced 2025-07-31 02:02:21 +06:00
Code Issues Actions 23 Packages Projects Releases Wiki Activity
1325459105
transformers/tests
History
Nicolas Patry 1325459105
Refactor whisper asr pipeline to include language too. (#21427) 
* [WIP] whisper refacto to support language output.

* Handling merges.

* A bit more cleanup and comments.

* Many improvements.

Lots of details everywhere.

* Cleanup old code and tests.

* Handle lone timestamp tokens (just recover when something bad happens).

* Adding return_language example.

* No ffmpeg.

* Hmm.

* Some corrections.

* Both fast and slow.

* New black.

* Update src/transformers/models/whisper/tokenization_whisper.py

Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>

* Update src/transformers/models/whisper/tokenization_whisper.py

Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>

* Remove print.

* Undoing tests modifications.

* Smaller test modifications.

* Rename.

* Remove maxDiff.

---------

Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>
2023-03-02 18:12:19 +01:00
..
benchmark [Test refactor 1/5] Per-folder tests reorganization (#15725) 2022-02-23 15:46:28 -05:00
deepspeed [deepspeed tests] fix issues introduced by #21700 (#21769) 2023-02-23 13:22:25 -08:00
extended Apply ruff flake8-comprehensions (#21694) 2023-02-22 09:14:54 +01:00
fixtures [WIP] add SpeechT5 model (#18922) 2023-02-03 12:43:46 -05:00
generation prepare for "__floordiv__ is deprecated and its behavior will change in a future version of pytorch" (#20211) 2023-03-01 10:49:21 +01:00
mixed_int8 [bnb] fix bnb decoders bug (#21688) 2023-02-20 12:21:58 +00:00
models Refactor whisper asr pipeline to include language too. (#21427) 2023-03-02 18:12:19 +01:00
onnx Update quality tooling for formatting (#21480) 2023-02-06 18:10:56 -05:00
optimization Make schedulers picklable by making lr_lambda fns global (#21768) 2023-03-02 12:08:43 -05:00
pipelines Refactor whisper asr pipeline to include language too. (#21427) 2023-03-02 18:12:19 +01:00
repo_utils Add an utility file to get information from test files (#21856) 2023-03-01 17:53:29 +01:00
sagemaker Apply ruff flake8-comprehensions (#21694) 2023-02-22 09:14:54 +01:00
tokenization Update quality tooling for formatting (#21480) 2023-02-06 18:10:56 -05:00
trainer Fix flaky test for log level (#21776) 2023-02-28 16:24:14 -05:00
utils Fix flaky test for log level (#21776) 2023-02-28 16:24:14 -05:00
__init__.py GPU text generation: mMoved the encoded_prompt to correct device 2020-01-06 15:11:12 +01:00
test_configuration_common.py Update quality tooling for formatting (#21480) 2023-02-06 18:10:56 -05:00
test_feature_extraction_common.py Update quality tooling for formatting (#21480) 2023-02-06 18:10:56 -05:00
test_image_processing_common.py Make ImageProcessorMixin compatible with subfolder kwarg (#21725) 2023-02-23 09:28:18 +01:00
test_image_transforms.py Update quality tooling for formatting (#21480) 2023-02-06 18:10:56 -05:00
test_modeling_common.py [tests] add accelerate marker (#21743) 2023-02-27 12:33:34 +01:00
test_modeling_flax_common.py [Flax] adding support for batch norm layers (#21581) 2023-02-24 08:47:33 +01:00
test_modeling_tf_common.py Improve TF weight loading, especially PT crossloading (#21792) 2023-02-28 18:41:34 +00:00
test_pipeline_mixin.py Mark pipeline tests to skip them easily (#21887) 2023-03-02 10:55:36 -05:00
test_sequence_feature_extraction_common.py Apply ruff flake8-comprehensions (#21694) 2023-02-22 09:14:54 +01:00
test_tokenization_common.py Cleanup quality (#21493) 2023-02-07 12:27:31 -05:00