Yih-Dar
f1e42bc50e
Some fixes regarding auto mappings and test class names ( #19923 )
...
* Add pegasus_x
* ViTMSN
* ESM
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
2022-10-27 14:38:59 +02:00
Chandler May
bec78ba154
Convert None logits processor/stopping criteria to empty list. ( #19880 )
...
* Convert None logits processor/stopping criteria to empty list.
* Initialize stopping_criteria, logits_processor in generate.
* Default stopping_criteria, logits_processor to None.
Co-authored-by: Chandler May <chandler.j.may@gmail.com>
2022-10-27 08:00:18 -04:00
Joao Gante
568e578310
Generate: contrastive search uses existing abstractions and conventions ( #19896 )
2022-10-27 12:20:14 +01:00
Yih-Dar
803475fb69
Add checkpoint links in a few config classes ( #19910 )
...
* For CLIP
* Others
* update
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
2022-10-27 09:26:10 +02:00
Younes Belkada
7629656926
accelerate support for RoBERTa family (#19906 )
2022-10-26 22:41:53 +02:00
Patrick von Platen
6d023270f6
Allow flax subfolder ( #19902 )
...
* add first generation tutorial
* [Flax] Add subfolder functionality
* [Flax] Add subfolder functionality
* up
* finish
* delete file and re-add test
2022-10-26 18:33:23 +02:00
Younes Belkada
7a1c68a845
Add flan-t5 documentation page ( #19892 )
...
* add `flan-t5` documentation page
* Update README.md
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
* add more content
* revert `_toctree` modif
* revert `toctree` modif - 2
* Update README.md
* Revert "Update README.md"
This reverts commit 5660714429
2022-10-26 17:22:57 +02:00
Yih-Dar
688c3e8e40
Update max_diff in test_save_load_fast_init_to_base ( #19849 )
...
* Fix test_save_load_fast_init_to_base
* Fix test_save_load_fast_init_to_base
* update
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
2022-10-26 17:09:47 +02:00
raghavanone
7829c890db
Change the import of kenlm from github to pypi ( #19770 )
...
* Change the import of kenlm from github to pypi
* Change the import of kenlm from github to pypi in circleci config
* Fix code quality issues
* Fix isort issue, add kenlm in extras for audio
* Add kenlm to deps
* Add kenlm to deps
* Commit 'make fixup' changes
* Remove version from kenlm deps
* commit make fixup changes
* Remove manual installation of kenlm
* Remove manual installation of kenlm
* Remove manual installation of kenlm
2022-10-26 17:06:46 +02:00
raghavanone
aeae97829f
Add missing information on token_type_ids for roberta model ( #19766 )
...
* Add missing information on token_type_ids for roberta model
* Fix code format issues
* Fix code format issues
* Add more explicit document for token_type_ids for roberta
* Fix flake8 issues
* Fix flake8 issues
* Fix flake8 issues
* Fix flake8 issues
* Fix flake8 issues
2022-10-26 10:44:34 -04:00
Sander Land
fdffee8a60
No conv bn folding in ipex to avoid warning ( #19870 )
...
* no conv bn folding in ipex
* no flag in training
* comment
Co-authored-by: Sander Land <sander@chatdesk.com>
2022-10-26 08:58:52 -04:00
Kaylee L. Davis
802b98c72b
Correct README image text ( #19883 )
...
swap "right" and "left" so description is correct.
2022-10-26 08:38:01 -04:00
regisss
5d2d51a0fb
Fix LR ( #19875 )
2022-10-26 08:35:53 -04:00
Revanth09
1f1cc09df6
[DOCTEST] Config doctest for MCTCT, MBart and LayoutLM ( #19889 )
...
* Update documentation_tests.txt
* Update configuration_mbart.py
* Update configuration_mctct.py
* Update configuration_layoutlm.py
* Update configuration_layoutlmv2.py
* Update configuration_layoutlmv3.py
* Update documentation_tests.txt
2022-10-26 12:05:44 +02:00
Nicolas Patry
5fd5990dce
Factored out some code in the image-segmentation pipeline. ( #19727 )
...
* Factored out some code in the image-segmentation pipeline
Re-enable `small_model_pt`.
Re-enable `small_model_pt`.
Enabling the current test with the current values.
Debugging the values on the CI.
More logs ? Printing doesn't work ?
Using the CI values instead. Seems to be a Pillow sensitivity.
Added a test showcasing that models not supporting some tasks get a
clear error.
Factored out code.
Further factor out.
Fixup.
Bad rebase.
Put `panoptic` before `instance` as it should be a superset.
* Fixing tests.
* Adding subtasks tests
+ Fixes `instance` segmentation which was broken due to default and
non kwargs arguments.
* Fix bad replace.
2022-10-26 10:44:36 +02:00
Sylvain Gugger
2447672269
Update doc for revision and token ( #19793 )
...
* Update doc for revision and token
* Update src/transformers/configuration_utils.py
Co-authored-by: Lysandre Debut <lysandre.debut@reseau.eseo.fr>
* Push changes on other from_pretrained methods
Co-authored-by: Lysandre Debut <lysandre.debut@reseau.eseo.fr>
2022-10-25 12:32:15 -04:00
Yih-Dar
f9257843b5
Fix incorrect model<->tokenizer mapping in tokenization testing ( #19872 )
...
* Fix model-tokenizer mapping
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
2022-10-25 16:02:13 +02:00
Lysandre Debut
eedaba682f
[Past CI] Vilt only supports PT >= v1.10 ( #19851 )
...
* Support for Vilt in v1.9
* Skip if not higher or equal than 1.10
* Move test :)
* I am bad at python
2022-10-25 15:59:35 +02:00
Joao Gante
d39f794eda
Generate: contrastive search cosmetic tweaks ( #19871 )
2022-10-25 14:43:06 +01:00
Davi Alves
0a77249178
Added translation of serialization.mdx to Portuguese Issue #16824 ( #19869 )
...
* [ custom_models.mdx ] - Translated to Portuguese the custom models tutorial.
* [ run_scripts.mdx ] - Translated to Portuguese the run scripts tutorial.
* [ converting_tensorflow_models.mdx ] - Translated to Portuguese the converting tensorflow models tutorial.
* [ converting_tensorflow_models.mdx ] - Translated to Portuguese the converting tensorflow models tutorial.
* [ serialization.mdx ] - Translated to Portuguese the serialization tutorial.
2022-10-25 09:34:28 -04:00
Guillaume Klein
ab108a0e31
Add missing lang tokens in M2M100Tokenizer.get_vocab ( #18416 )
2022-10-25 09:18:24 -04:00
Yih-Dar
0bd6d9340e
Fix doctest for GenerationMixin.contrastive_search ( #19863 )
...
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
2022-10-25 14:51:16 +02:00
Alberto Mario Ceballos-Arroyo
371337a95b
Spanish translation of multiple_choice.mdx, question_answering.mdx. ( #19821 )
...
* Translated multiple_choice.mdx, question_answering.mdx. Added them to _toctree.yml
* Added translation for a missed line.
* Update _toctree.yml as per Omar's suggestions
* Update multiple_choice.mdx as per Omar's comments
* Updt question_answering.mdx as per Omar's comments
2022-10-24 20:11:34 -04:00
Sylvain Gugger
d4eb52d13d
Refactor conversion function ( #19799 )
...
* Refactor conversion function
* Remove dupe line
* Fixes
* Fixes
* Use the right variable...
* Fix last test
2022-10-24 13:48:40 -04:00
Steven Liu
9ecb13d63a
add small updates only ( #19847 )
2022-10-24 10:18:20 -07:00
Yih-Dar
072ed01c38
Fix doctest for MarkupLM ( #19845 )
...
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
2022-10-24 17:54:23 +02:00
Rak Alexey
1f7e40d04f
Improve check copies ( #19829 )
...
* print first diff line intead of first code part line
* fix style
2022-10-24 11:24:18 -04:00
Yih-Dar
8b2501b4b9
Update LEDModelIntegrationTests expected values ( #19841 )
...
* Update expected values
* fix style
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
2022-10-24 16:05:26 +02:00
Dhruv Singal
5cbf1fa8ca
fixed typo in fp16 training section for perf_train_gpu_one ( #19736 )
2022-10-24 10:04:28 -04:00
Yih-Dar
8db92dbe26
Fix nightly CircleCI ( #19837 )
...
* Fix nightly CircleCI
* update
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
2022-10-24 16:00:02 +02:00
Davi Alves
743995e0e6
Added translation of converting_tensorflow_models.mdx to Portuguese Issue #16824 ( #19824 )
...
* [ custom_models.mdx ] - Translated to Portuguese the custom models tutorial.
* [ run_scripts.mdx ] - Translated to Portuguese the run scripts tutorial.
* [ converting_tensorflow_models.mdx ] - Translated to Portuguese the converting tensorflow models tutorial.
* [ converting_tensorflow_models.mdx ] - Translated to Portuguese the converting tensorflow models tutorial.
2022-10-24 09:50:16 -04:00
Rak Alexey
d3f4cef74d
fix image2test args forwarding ( #19648 )
...
* fix image2test args forwarding
* fix issues
* Proposing the update to the PR.
* Fixup.
Co-authored-by: Nicolas Patry <patry.nicolas@protonmail.com>
2022-10-24 09:49:24 -04:00
zhou fan
3b419cfc6f
fix broken links in testing.mdx ( #19820 )
2022-10-24 09:48:02 -04:00
Yih-Dar
7ccd6fc47c
Fix OOM in Config doctest ( #19840 )
...
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
2022-10-24 15:33:00 +02:00
Angus L'Herrou
18adc40d87
replace reference to Datasets in metrics deprecation with Evaluate ( #19812 )
2022-10-24 09:25:57 -04:00
regisss
0b59ecdefd
Display the number of trainable parameters when lauching a training ( #19835 )
2022-10-24 09:15:52 -04:00
Ayaka
536f338441
[Doctest] Add configuration_nezha.py ( #19810 )
...
* [Doctest] Add `configuration_nezha.py`
* Revert line order
2022-10-24 13:50:43 +02:00
Ayaka
f58b211ed3
[Doctest] Add configuration_electra.py ( #19807 )
2022-10-24 12:34:43 +02:00
Ayaka
c949188b9d
[Doctest] Add configuration_poolformer.py ( #19808 )
2022-10-24 12:33:46 +02:00
Ayaka
82df83a96b
[Doctest] Add configuration_plbart.py ( #19809 )
...
Additionally, I updated the doctest format to be consistent with BERT.
2022-10-24 12:32:55 +02:00
sha016
22502ebb85
[Doctest] MaskFormerConfig doctest ( #19817 )
2022-10-24 11:08:32 +02:00
ydshieh
6f8064da6b
install GitPython
2022-10-24 09:54:15 +02:00
Joao Gante
674f750a57
Generate: minor docstring fix ( #19801 )
2022-10-23 10:46:47 +01:00
Davi Alves
74b3eb3dea
Added translation of run_scripts.mdx to Portuguese Issue #16824 ( #19800 )
...
* [ custom_models.mdx ] - Translated to Portuguese the custom models tutorial.
* [ run_scripts.mdx ] - Translated to Portuguese the run scripts tutorial.
2022-10-21 17:38:35 -04:00
Yih-Dar
3436842102
Run some TF Whisper tests in subprocesses to avoid GPU OOM ( #19772 )
...
* Run some TF Whisper tests in subprocesses to avoid GPU OOM
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
2022-10-21 21:59:18 +02:00
Joao Gante
e0b825a8d0
Generate: contrastive search test updates ( #19787 )
...
* contrastive search test updates
* make fixup
2022-10-21 19:10:08 +01:00
Sylvain Gugger
c4a997cd85
Use None to detect if truncation was unset ( #19794 )
...
* Use None to detect if truncation was unset
* Fix repo consistency
2022-10-21 12:53:37 -04:00
Serhii Hamotskyi
2e5c6f5975
Fix error/typo in docstring of TokenClassificationPipeline ( #19798 )
2022-10-21 12:53:16 -04:00
Alara Dirik
cca51aa151
Fix image segmentation pipeline errors, resolve backward compatibility issues ( #19768 )
...
* Fix panoptic segmentation and pipeline
* Update ImageSegmentationPipeline tests and reenable test_small_model_pt
* Resolve backward compatibility issues
2022-10-21 18:09:58 +03:00
Sylvain Gugger
b58d4f70f6
Fix nightly test setup ( #19792 )
2022-10-21 10:26:30 -04:00
