riaz.somc/transformers
1
0
Fork 0
mirror of https://github.com/huggingface/transformers.git synced 2025-07-29 01:02:25 +06:00
Code Issues Actions 23 Packages Projects Releases Wiki Activity
11,371 Commits 886 Branches 231 Tags 1.9 GiB
f10cdba22e
Commit Graph

11371 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
zhou fan
3b419cfc6f
fix broken links in testing.mdx (#19820) 2022-10-24 09:48:02 -04:00
Yih-Dar
7ccd6fc47c
Fix OOM in Config doctest (#19840) 
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2022-10-24 15:33:00 +02:00
Angus L'Herrou
18adc40d87
replace reference to Datasets in metrics deprecation with Evaluate (#19812) 2022-10-24 09:25:57 -04:00
regisss
0b59ecdefd
Display the number of trainable parameters when lauching a training (#19835) 2022-10-24 09:15:52 -04:00
Ayaka
536f338441
[Doctest] Add configuration_nezha.py (#19810) 
* [Doctest] Add `configuration_nezha.py`

* Revert line order
 2022-10-24 13:50:43 +02:00
Ayaka
f58b211ed3
[Doctest] Add configuration_electra.py (#19807) 2022-10-24 12:34:43 +02:00
Ayaka
c949188b9d
[Doctest] Add configuration_poolformer.py (#19808) 2022-10-24 12:33:46 +02:00
Ayaka
82df83a96b
[Doctest] Add configuration_plbart.py (#19809) 
Additionally, I updated the doctest format to be consistent with BERT.
 2022-10-24 12:32:55 +02:00
sha016
22502ebb85
[Doctest] MaskFormerConfig doctest (#19817) 2022-10-24 11:08:32 +02:00
ydshieh
6f8064da6b install GitPython 2022-10-24 09:54:15 +02:00
Joao Gante
674f750a57
Generate: minor docstring fix (#19801) 2022-10-23 10:46:47 +01:00
Davi Alves
74b3eb3dea
Added translation of run_scripts.mdx to Portuguese Issue #16824 (#19800) 
* [ custom_models.mdx ] - Translated to Portuguese the custom models tutorial.

* [ run_scripts.mdx ] - Translated to Portuguese the run scripts tutorial.
 2022-10-21 17:38:35 -04:00
Yih-Dar
3436842102
Run some TF Whisper tests in subprocesses to avoid GPU OOM (#19772) 
* Run some TF Whisper tests in subprocesses to avoid GPU OOM

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2022-10-21 21:59:18 +02:00
Joao Gante
e0b825a8d0
Generate: contrastive search test updates (#19787) 
* contrastive search test updates

* make fixup
 2022-10-21 19:10:08 +01:00
Sylvain Gugger
c4a997cd85
Use None to detect if truncation was unset (#19794) 
* Use None to detect if truncation was unset

* Fix repo consistency
 2022-10-21 12:53:37 -04:00
Serhii Hamotskyi
2e5c6f5975
Fix error/typo in docstring of TokenClassificationPipeline (#19798) 2022-10-21 12:53:16 -04:00
Alara Dirik
cca51aa151
Fix image segmentation pipeline errors, resolve backward compatibility issues (#19768) 
* Fix panoptic segmentation and pipeline
* Update ImageSegmentationPipeline tests and reenable test_small_model_pt
* Resolve backward compatibility issues
 2022-10-21 18:09:58 +03:00
Sylvain Gugger
b58d4f70f6
Fix nightly test setup (#19792) 2022-10-21 10:26:30 -04:00
Yih-Dar
3a1aeea3c5
Fix CTRL test_torchscrip_xxx CI by updating _create_and_check_torchscript (#19786) 
* Run inputs before trace

* Run inputs before trace

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2022-10-21 16:23:13 +02:00
Hao Wang
31565ff0fd
Add sentencepiece to BertJapaneseTokenizer (#19769) 
* support sentencepiece for bertjapanesetokenizer

* add test vocab file for sentencepiece, bertjapanesetokenizer

* make BasicTokenizer be identical to transformers.models.bert.tokenization_bert.BasicTokenizer

* fix missing of \n in comment

* fix init argument missing in tests

* make spm_file be optional, exclude spiece.model from tests/fixtures, and add description comments

* make comment length less than 119

* apply doc style check
 2022-10-21 10:04:49 -04:00
Davi Alves
2ebf4e6a7b
[ custom_models.mdx ] - Translated to Portuguese the custom models tutorial. (#19779) 2022-10-21 09:48:19 -04:00
ftorres16
c1f009ad9a
Update training.mdx (#19791) 2022-10-21 09:46:44 -04:00
Sylvain Gugger
9151e649a5
Make public versions of private tensor utils (#19775) 
* Make public versions of private utils

* I need sleep
 2022-10-21 09:34:01 -04:00
Yih-Dar
3aaabaa214
Update ImageToTextPipelineTests.test_small_model_tf (#19785) 
* update expected values for the correct TF checkpoint

* Run test

* Clean up

* fix

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2022-10-21 14:35:20 +02:00
Kashif Rasul
7487829a23
Added support for multivariate independent emission heads (#19453) 
* Added support for multivariate independent emission heads

* fix typo

* rename distr_cls

* scale is a vector for multivariate

* set affine transform event_dim

* fix typo

* added variable

* added beta in the config

* set beta

* remove beta-nll option in nll
 2022-10-21 08:32:10 -04:00
Matt
a5da6f1817
Add warning about restarting runtime to import errors (#19774) 
* Add warning about restarting runtime to import errors

* Fix some linebreaks
 2022-10-21 11:52:29 +01:00
Yih-Dar
84f6bee5da
PT <-> TF for composite models (#19732) 
* First step of PT->TF for composite models

* Update the tests

* For VisionEncoderDecoderModel

* Fix

* Fix

* Add comment

* Fix

* clean up import

* Save memory

* For (TF)EncoderDecoderModel

* For (TF)EncoderDecoderModel

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2022-10-21 12:40:39 +02:00
Yih-Dar
12ce2941c7
Fix docker image build (#19759) 
* Use 2 jobs for the docker image build (latest torch + DS)

* fix

* Add comment

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2022-10-20 20:36:13 +02:00
Yih-Dar
15fd39ea0e
Install tf2onnx dev version (#19755) 
* pin tf2onnx<=1.12.0

* Install tf2onnx main

* Pin to a specific commit

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2022-10-20 20:24:39 +02:00
Joao Gante
5ed9bd1896
TF: sample generation compatible with XLA and dynamic batch sizes (#19773) 2022-10-20 19:01:22 +01:00
Lianmin Zheng
c186e816bd
[FLAX] Add dtype to embedding for gpt2 model (#18462) 
* [FLAX] Add dtype to embedding for gpt2 model

* lint
 2022-10-20 18:15:49 +02:00
Chino
baa00f65ae
Fix exception thrown using MishActivation (#19739) 
* Fix exception thrown using MishActivation

* Update activations.py
 2022-10-20 09:13:35 -04:00
Rohit Gupta
2dd1b8f0c5
adding key pair dataset (#19765) 2022-10-20 09:05:49 -04:00
IMvision12
17d7aec895
Update modeling_layoutlmv3.py (#19753) 2022-10-20 13:47:17 +01:00
Nicolas Patry
a40386669f
image-segmentation pipeline: re-enable small_model_pt test. (#19716) 
* Re-enable `small_model_pt`.

Re-enable `small_model_pt`.

Enabling the current test with the current values.

Debugging the values on the CI.

More logs ? Printing doesn't work ?

Using the CI values instead. Seems to be a Pillow sensitivity.

* Update src/transformers/pipelines/image_segmentation.py

Co-authored-by: Alara Dirik <8944735+alaradirik@users.noreply.github.com>

Co-authored-by: Alara Dirik <8944735+alaradirik@users.noreply.github.com>
 2022-10-20 11:57:11 +02:00
Rohith ND
eb98da9880
[Doctest] OpenAIGPTConfig and OPTConfig (#19763) 2022-10-20 10:22:00 +02:00
Partho
506355ca75
[Doctest] SpeechToTextTransformer2 Config for doctest (#19756) 2022-10-20 10:19:06 +02:00
Partho
123f65eea6
[Doctest] SqueezeBERT Config for doctest (#19758) 2022-10-20 10:16:39 +02:00
Partho
cc03063366
[Doctest] SpeechToTextTransformer Config for doctest (#19757) 2022-10-20 10:15:07 +02:00
Mohammed Faizan Ahmed
bbe2c8b126
All broken links were fixed in contributing file (#19760) 2022-10-19 16:44:03 -04:00
shreya24ag
5602a3ae1e
Fixed spacing errors (#19754) 
Co-authored-by: Shreya <>
 2022-10-19 14:54:30 -04:00
Xabier Lahuerta Vazquez
0a03741590
[Doctest] Add configuration_detr.py (#19752) 2022-10-19 18:13:34 +02:00
Xabier Lahuerta Vazquez
65d36ee861
[Doctest] Add configuration_decision_transformer.py (#19751) 2022-10-19 18:12:34 +02:00
amyeroberts
5041bc3511
Image transforms add center crop (#19718) 
* Add center crop to transforms library

* Return PIL images if PIL image input by default

* Fixup and add docstring

* Trigger CI

* Update src/transformers/image_transforms.py

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* Update src/transformers/image_transforms.py

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* PR comments - move comments; unindent

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
 2022-10-19 16:15:01 +01:00
Sylvain Gugger
44a40c1466
Fix cache version file creation (#19750) 2022-10-19 10:55:57 -04:00
Yih-Dar
bed2edb99f
Specify TF framework explicitly in more pipeline tests (#19748) 
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2022-10-19 16:24:03 +02:00
JuanCarlosPi
c206fc8779
[Doctest] Add configuration_wavlm.py (#19749) 
* Change the import order of the model and configuration classes

* Add (with random weights) in the comment before model initialization

* Add configuration_wavlm to doctest
 2022-10-19 16:10:13 +02:00
raghavanone
b17a5e0074
Fix issue #19300 (#19483) 
* Fix issue #19300

* Fixing import order

* Fix issue #19300

* Fix formatting issues

* Update src/transformers/trainer.py

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* Refactor method

* Refactor method

* Fix the issue of sending wrong output dir

* Remove unused code

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
 2022-10-19 09:55:37 -04:00
IMvision12
d2ed8134f1
Update modeling_markuplm.py (#19723) 2022-10-19 13:46:11 +01:00
Rohith ND
7df0751cc6
[Doctest] GPTNeoConfig , GPTNeoXConfig , GPTNeoXJapaneseConfig (#19741) 2022-10-19 14:22:41 +02:00