riaz.somc/transformers
1
0
Fork 0
mirror of https://github.com/huggingface/transformers.git synced 2025-07-31 02:02:21 +06:00
Code Issues Actions 23 Packages Projects Releases Wiki Activity
255257f3ea
transformers/tests
History
Arthur 255257f3ea
[Whisper] Refactor whisper (#21252) 
* update whisper logit processor

* add generate for whisper

* remove part of the whisper specific code from pipeline

* update logit processes

* major update

* enforce first timestamp

* update generate

* add more tests

* update new decoding strategy

* Apply suggestions from code review

* update docstring

* fixup

* default config will not have multilingual ar

* update expected tokenizer size, see pull on the hub for whisper-tiny
2023-01-25 13:09:43 +01:00
..
benchmark [Test refactor 1/5] Per-folder tests reorganization (#15725) 2022-02-23 15:46:28 -05:00
deepspeed [examples/deepspeed] fix renamed api (#21283) 2023-01-24 09:54:33 -08:00
extended [bnb optim] fixing test (#21030) 2023-01-12 08:52:54 -08:00
fixtures add a warning in SpmConverter for sentencepiece's model using the byte fallback feature (#16629) 2022-04-11 11:06:10 +02:00
generation [GenerationConfig] add additional kwargs handling (#21269) 2023-01-24 19:04:42 +01:00
mixed_int8 [t5] Fix T5 inference in float16 + bnb error (#21281) 2023-01-24 18:14:38 +01:00
models [Whisper] Refactor whisper (#21252) 2023-01-25 13:09:43 +01:00
onnx Add Onnx Config for PoolFormer (#20868) 2022-12-23 01:30:57 -05:00
optimization [Test refactor 1/5] Per-folder tests reorganization (#15725) 2022-02-23 15:46:28 -05:00
pipelines [Whisper] Refactor whisper (#21252) 2023-01-25 13:09:43 +01:00
repo_utils Repo utils test (#19696) 2022-10-18 13:47:36 -04:00
sagemaker transformers-cli login => huggingface-cli login (#18490) 2022-08-06 09:42:55 +02:00
tokenization fix train_new_from_iterator in the case of byte-level tokenizers (#17549) 2022-06-08 15:30:41 +02:00
trainer Add AWS Neuron torchrun support (#20806) 2023-01-18 11:21:19 -05:00
utils Fixing offline mode for pipeline (when inferring task). (#21113) 2023-01-17 15:24:40 +01:00
__init__.py GPU text generation: mMoved the encoded_prompt to correct device 2020-01-06 15:11:12 +01:00
test_configuration_common.py Add WhisperModel to transformers (#19166) 2022-10-05 22:28:31 +02:00
test_feature_extraction_common.py Add test_image_processing_common.py (#20785) 2023-01-23 13:48:30 +00:00
test_image_processing_common.py Add test_image_processing_common.py (#20785) 2023-01-23 13:48:30 +00:00
test_image_transforms.py Move convert_to_rgb to image_transforms module (#20784) 2022-12-15 18:47:04 +00:00
test_modeling_common.py Generate: save generation config with the models' .save_pretrained() (#21264) 2023-01-23 16:21:44 +00:00
test_modeling_flax_common.py Generate: save generation config with the models' .save_pretrained() (#21264) 2023-01-23 16:21:44 +00:00
test_modeling_tf_common.py Generate: save generation config with the models' .save_pretrained() (#21264) 2023-01-23 16:21:44 +00:00
test_sequence_feature_extraction_common.py Some tests misusing assertTrue for comparisons fix (#16771) 2022-04-19 14:44:08 +02:00
test_tokenization_common.py 🚨 🚨 🚨 Fix Issue 15003: SentencePiece Tokenizers Not Adding Special Tokens in convert_tokens_to_string (#15775) 2022-11-02 15:45:38 -04:00