Anton Lozhkov
|
75f6641eaf
|
[Wav2Vec2FeatureExtractor] Fix extractor.pad() dtype backwards compatibility (#13693)
* Force dtype, add tests
* Local torch imports
* Remove unused logic (always ndarray)
|
2021-09-22 11:02:54 +02:00 |
|
Anton Lozhkov
|
1417978cd4
|
[SequenceFeatureExtractor] Rewrite padding logic from pure python to numpy (#13650)
* Test np padding
* Pass feature extraction tests
* Update type hints
* Fix flaky integration tests
* Try a more stable waveform
* Add to_numpy jax support
* int32 attention masks
* Refactor normalization tests
|
2021-09-21 17:10:13 +03:00 |
|
Patrick von Platen
|
4d5b4c7863
|
Feature Extractor: Wav2Vec2 & Speech2Text - Allow truncation + padding=longest (#13600)
* correct
* add tests
* Update src/transformers/feature_extraction_sequence_utils.py
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
|
2021-09-16 20:02:54 +02:00 |
|
Patrick von Platen
|
d7b3b709d0
|
[Wav2Vec2] Fix normalization for non-padded tensors (#13512)
* finalize
* Apply suggestions from code review
* finish cleaner implementation
* more tests
* small fix
* finish
* up
|
2021-09-10 15:27:16 +02:00 |
|
Patrick von Platen
|
f6e254474c
|
[Sequence Feature Extraction] Add truncation (#12804)
* fix_torch_device_generate_test
* remove @
* add truncate
* finish
* correct test
* Apply suggestions from code review
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
* clean tests
* correct normalization for truncation
* remove casting
* up
* save intermed
* finish
* finish
* correct
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
|
2021-07-23 17:53:30 +02:00 |
|
Lysandre Debut
|
2adc8c926a
|
W2v2 test require torch (#10665)
* Adds a @require_torch to a test that requires it
* Tokenizer too
* Style
|
2021-03-11 12:56:12 -05:00 |
|
Patrick von Platen
|
9a06b6b11b
|
[FeatureExtractorSavingUtils] Refactor PretrainedFeatureExtractor (#10594)
* save first version
* finish refactor
* finish refactor
* correct naming
* correct naming
* shorter names
* Update src/transformers/feature_extraction_common_utils.py
Co-authored-by: Lysandre Debut <lysandre@huggingface.co>
* change name
* finish
Co-authored-by: Lysandre Debut <lysandre@huggingface.co>
|
2021-03-09 12:16:59 +03:00 |
|
Patrick von Platen
|
cb38ffcc5e
|
[PretrainedFeatureExtractor] + Wav2Vec2FeatureExtractor, Wav2Vec2Processor, Wav2Vec2Tokenizer (#10324)
* push to show
* small improvement
* small improvement
* Update src/transformers/feature_extraction_utils.py
* Update src/transformers/feature_extraction_utils.py
* implement base
* add common tests
* make all tests pass for wav2vec2
* make padding work & add more tests
* finalize feature extractor utils
* add call method to feature extraction
* finalize feature processor
* finish tokenizer
* finish general processor design
* finish tests
* typo
* remove bogus file
* finish docstring
* add docs
* finish docs
* small fix
* correct docs
* save intermediate
* load changes
* apply changes
* apply changes to doc
* change tests
* apply surajs recommend
* final changes
* Apply suggestions from code review
* fix typo
* fix import
* correct docstring
|
2021-02-25 17:42:46 +03:00 |
|