riaz.somc/transformers
1
0
Fork 0
mirror of https://github.com/huggingface/transformers.git synced 2025-07-21 05:28:21 +06:00
Code Issues Actions 7 Packages Projects Releases Wiki Activity
15,053 Commits 876 Branches 227 Tags 2 GiB
3f9f749325
Commit Graph

15053 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Clémentine Fourrier
4bbbabcb2c
Added clefourrier as ref point for graph models in bug reports (#21139) 
* Added clefourrier as ref point for graph models in bug reports

* Update PULL_REQUEST_TEMPLATE.md
 2023-01-16 15:12:42 +01:00
Yih-Dar
a45914193a
Fix RealmModelIntegrationTest.test_inference_open_qa (#21136) 
fix

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2023-01-16 15:09:52 +01:00
Susnato Dhar
a5327c6a9a
Fixed issue #21053 (#21065) 
Co-authored-by: susnato <susnato@tensorflow123456@gmail.com>
 2023-01-16 15:06:35 +01:00
Nicolas Patry
488a179ce1
Fixing batching pipelines on single items for ChunkPipeline (#21132) 
* Fixing #20783

* Update src/transformers/pipelines/base.py

* Fixing some tests.

* Fixup.

* Remove ffmpeg dep + a bit more relaxed for bigbird QA precision.

* Better dataset.

* Prevent failing on TF.

* Better condition. We can't use `can_use_iterator` since we cannot use it
directly.
 2023-01-16 15:04:27 +01:00
Silver
fa906a264b
Add min_new_tokens argument in generate() (implementation based on MinNewTokensLengthLogitsProcessor) (#21044) 
add a new parameter min_new_tokens for generate()
 2023-01-16 15:02:08 +01:00
guillaume-be
125f137562
[LongT5] Remove duplicate encoder_attention_mask default value check (#21124) 
- Remove duplicate encoder_attention_mask default value assignment
 2023-01-16 14:26:56 +01:00
NielsRogge
05b8e25fff
[VideoMAE] Fix docstring (#21111) 
Fix docstring

Co-authored-by: Niels Rogge <nielsrogge@Nielss-MacBook-Pro.local>
 2023-01-16 09:39:35 +01:00
NielsRogge
4ed89d48ab
Add UperNet (#20648) 
* First draft

* More improvements

* Add convnext backbone

* Add conversion script

* Add more improvements

* Comment out to_dict

* Add to_dict method

* Add default config

* Fix config

* Fix backbone

* Fix backbone some more

* Add docs, auto mapping, tests

* Fix some tests

* Fix more tests

* Fix more tests

* Add conversion script

* Improve conversion script

* Add support for getting reshaped undownsampled hidden states

* Fix forward pass

* Add print statements

* Comment out set_shift_and_window_size

* More improvements

* Correct downsampling layers conversion

* Fix style

* First draft

* Fix conversion script

* Remove config attribute

* Fix more tests

* Update READMEs

* Update ConvNextBackbone

* Fix ConvNext tests

* Align ConvNext with Swin

* Remove files

* Fix index

* Improve docs

* Add output_attentions to model forward

* Add backbone mixin, improve tests

* More improvements

* Update init_weights

* Fix interpolation of logits

* Add UperNetImageProcessor

* Improve image processor

* Fix image processor

* Remove print statements

* Remove script

* Update import

* Add image processor tests

* Remove print statements

* Fix test

* Add integration test

* Add convnext integration test

* Update docstring

* Fix README

* Simplify config

* Apply suggestions

* Improve docs

* Rename class

* Fix test_initialization

* Fix import

* Address review

* Fix confg

* Convert all checkpoints

* Fix default backbone

* Usage same processor as segformer

* Apply suggestions

* Fix init_weights, update conversion scripts

* Improve config

* Use Auto API instead of creating a new image processor

* Fix docs

* Add doctests

* Remove ResNetConfig dependency

* Add always_partition argument

* Fix rebaseé

* Improve docs

* Convert checkpoints

Co-authored-by: Niels Rogge <nielsrogge@Nielss-MacBook-Pro.local>
Co-authored-by: Niels Rogge <nielsrogge@Nielss-MBP.localdomain>
 2023-01-16 09:39:13 +01:00
TK Buristrakul
5db9abde43
Fixed typo in docstring (#21115) 
Fixed typo
 2023-01-15 11:03:30 +01:00
Yusuke Oda
15adc24208
Use raw string for regex in tokenization_t5_fast.py (#21125) 
Suppress deprecation warning
 2023-01-15 10:56:31 +01:00
Arthur
056218dab1
[CI-doc-daily] Remove RobertaPreLayernorm random tests (#20992) 
* Remove random output

* remove values

* fix copy statements
 2023-01-14 19:47:32 +01:00
Sylvain Gugger
c8f35a9ce3
Rework automatic code samples in docstrings (#20757) 
* Rework automatic code samples in docstrings

* ImageProcessor->AutoImageProcessor

* Add models to fix copies

* Last typos

* A couple more models

* Fix copies
 2023-01-14 09:49:36 +01:00
Shogo Hida
7f65d2366a
Add Spanish translation to community.mdx (#21055) 
* Add community to toctree

Signed-off-by: Shogo Hida <shogo.hida@gmail.com>

* Copy English content

Signed-off-by: Shogo Hida <shogo.hida@gmail.com>

* Add some translations

Signed-off-by: Shogo Hida <shogo.hida@gmail.com>

* Add some translations

Signed-off-by: Shogo Hida <shogo.hida@gmail.com>

* Add some translations

Signed-off-by: Shogo Hida <shogo.hida@gmail.com>

* Fix position of community

Signed-off-by: Shogo Hida <shogo.hida@gmail.com>

* Fix translation

Signed-off-by: Shogo Hida <shogo.hida@gmail.com>

* Add translation

Signed-off-by: Shogo Hida <shogo.hida@gmail.com>

* Add translation

Signed-off-by: Shogo Hida <shogo.hida@gmail.com>

* Add translation

Signed-off-by: Shogo Hida <shogo.hida@gmail.com>

* Add translation

Signed-off-by: Shogo Hida <shogo.hida@gmail.com>

Signed-off-by: Shogo Hida <shogo.hida@gmail.com>
 2023-01-14 09:25:05 +01:00
Steven Liu
f58248b824
Update task summary part 1 (#21014) 
* first draft of new task summary

* make style

* review

* apply feedback

* apply feedbacks

* final touches
 2023-01-13 11:01:53 -08:00
Arthur
95f0dd2123
[Tokenizers] Fix a small typo (#21104) 
* typo

* change name in `__repr__`

* fix my mistake
 2023-01-13 16:21:34 +01:00
Yih-Dar
b210c83a78
Fix torchscript tests for AltCLIP (#21102) 
fix torchscript tests for AltCLIP

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2023-01-13 10:03:19 +01:00
Yih-Dar
b3a0aad37d
Fix past CI (#20967) 
* Fix for Past CI

* make style

* clean up

* unindent 2 blocks

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2023-01-12 18:04:21 +01:00
Stas Bekman
41b0564b35
[bnb optim] fixing test (#21030) 
* [bnb optim] fixing test

* force 1 gpu

* fix

* fix

* fix

* finalize

* improve commentary

* fix

* cleanup

* more fixes
 2023-01-12 08:52:54 -08:00
Yih-Dar
212829ade6
Remove more unused attributes in config classes (#21000) 
* Remove gradient_checkpointing from MarkupLMConfig

* Remove predict_special_tokens from OpenAIGPTConfig

* Remove enable_cls from RoCBertConfig

* Remove batch_size from TrajectoryTransformerConfig

* Remove searcher_seq_len from RealmConfig

* Remove feat_quantizer_dropout from WavLMConfig

* Remove position_biased_input from SEWDConfig

* Remove max_source_positions from Speech2Text2Config

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2023-01-12 13:32:04 +01:00
Susnato Dhar
b5be744d3c
Fixed issue #21039 (#21062) 
Fixed issue #21039 and added test for low_cpu_mem_usage
 2023-01-12 10:03:13 +01:00
Wang, Yi
e849e5bb4a
Optimize inference only mode memory if ipex is used (#21083) 
* Optimize inference only mode memory if ipex is used

Signed-off-by: Wang, Yi A <yi.a.wang@intel.com>

* fix code style

Signed-off-by: Wang, Yi A <yi.a.wang@intel.com>

Signed-off-by: Wang, Yi A <yi.a.wang@intel.com>
 2023-01-12 10:01:17 +01:00
zzz
6767ce71d6
fix typo in comment (#21088) 
fix typo

Signed-off-by: xiaoyang zhu <zhuxiaoyang1996@gmail.com>

Signed-off-by: xiaoyang zhu <zhuxiaoyang1996@gmail.com>
 2023-01-11 17:51:41 +01:00
Ying Zhang
64b6b2b273
Update docstring for CLIPConfig (#21066) 
Update doc for CLIPConfig
 2023-01-11 14:22:26 +01:00
Steven Liu
8f796960f6
Fix header level (#21072) 
fix header level
 2023-01-10 10:24:10 -08:00
Bharat Ramanathan
07cde58bdb
feature: update wandb callback to upload checkpoints (#21035) 
* docs: add wandb metrics and model checkpointing to callback docstrings

* docs: update reference to wandb documentation

* fix: change default of `"WANDB_WATCH"` from ``"gradients"` to ``"false"`

* feature: add `on_save` method and update `"WANDB_LOG_MODEL` behaviour

* fix: use default wandb run names instead of `output_dir`

- removes duplicated run names from wandb workspace
- models can be logged with corresponding run names

* fix: edit deprecation warning based on review suggestions

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* fix: change indentation of docstrings

* fix: change indentation of docstrings and run fixup

* fix: empty commit for circleci permissions issue

* fix: format deprecation doc strings review suggestion

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* docs: Highlight WANDB_DISABLED arg in documentaion

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* fix: run fixup after updating docstrings

Co-authored-by: Bharat Ramanathan <ramanathan.parameshwaran@gohuddl.com>
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>
 2023-01-10 18:43:22 +01:00
KarlFelixJoehnk
a3c37825cc
Make the attention_head_size in distilbert an object attribute (#20970) 
* [Fix] Make the attention head size in distilbert an object attribute

* Fix code style

Co-authored-by: Felix Joehnk <fjoehnk@N73GCH2NDH.corp.proofpoint.com>
 2023-01-09 18:17:16 +01:00
Arthur
e3ecbaa4ab
Patch-past-refactor (#21050) 
* small patches, forgot a line

* refactor PT

* the actual fix
 2023-01-09 18:12:13 +01:00
Yih-Dar
48d4e147d8
remove flax file from documentation_tests.txt (#21036) 
remove flax file from `documentation_tests.txt`

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2023-01-08 12:33:25 +01:00
Sylvain Gugger
d0f324f1e1
Fix warning for MCTC model (#21049) 2023-01-08 10:55:23 +01:00
Sylvain Gugger
9a046cc14e
Skip failing test until Athur looks at it. 2023-01-08 04:53:20 -05:00
Arthur
f0577df6de
Replace past with past_key_values (#20944) 
* start cleanup

* more updates

* more models are affected

* more updates

* update generation utils

* style

* revert change that removed reorder cachce

* update generation utils

* style

* style

* remove reorder cache
 2023-01-08 10:21:40 +01:00
SABA UL HAQUE
7cb596fa22
fix typo (#21048) 
Typo fix: Corrected the word metada --> metadata
 2023-01-08 10:03:01 +01:00
Kaito Sugimoto
bd9d51263a
fix typo (#21042) 2023-01-07 10:13:26 +01:00
Bartosz Szmelczynski
f93c90d217
fix levit timm conversion file (#20938) 
* fix levit timm conversion file

* remove set_defaults
 2023-01-06 13:27:30 +01:00
Ceyda Cinarel
c29bec485e
fix parameter name in docstring (#21032) 2023-01-06 07:23:16 -05:00
Dudu Lasry
61e068e5a2
Support turning off the model uploading in ClearML (#20969) 
* Add support for turning off the model uploading in ClearML

* Add documentation for the CLEARML_LOG_MODEL environment variable

* Adjust new doc addition to the new style

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

Co-authored-by: Dudu Lasry <dudu.lasry@viz.ai>
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
 2023-01-06 07:22:19 -05:00
Observer46
ff8dcb5efa
Fix arguments passed to predict function in QA Seq2seq training script (#21026) 
fix args passed to predict function
 2023-01-06 07:19:42 -05:00
Roy Hvaara
35a7052b61
[NumPy] Remove references to deprecated NumPy type aliases (#21022) 
[NumPy] Remove references to deprecated NumPy type aliases.

This change replaces references to a number of deprecated NumPy type aliases (np.bool, np.int, np.float, np.complex, np.object, np.str) with their recommended replacement (bool, int, float, complex, object, str).

NumPy 1.24 drops the deprecated aliases, so we must remove uses before updating NumPy.

Co-authored-by: Peter Hawkins <phawkins@google.com>

Co-authored-by: Peter Hawkins <phawkins@google.com>
 2023-01-05 13:02:10 -05:00
Magnus Pierrau
1d21471c78
Added mask_time_prob and mask_time_length arguments to wav2vec2 pretraining script (#20985) 
Added mask_time_prob and mask_time_length arguments to wav2vec2 pretraining script and readme - new branch
 2023-01-05 16:24:55 +00:00
Joao Gante
bc53fc6265
Generate: FLAX uses GenerationConfig as the basis for .generate() parametrization (#21007) 2023-01-05 15:41:37 +00:00
NielsRogge
4f1c9d162e
[CLIPSeg] Fix integration test (#20995) 
Fix integration test

Co-authored-by: Niels Rogge <nielsrogge@Nielss-MacBook-Pro.local>
 2023-01-05 14:30:32 +01:00
Sylvain Gugger
12313838d3
Make sure dynamic objects can be saved and reloaded (#21008) 
* Make sure dynamic objects can be saved and reloaded

* Remove processor test
 2023-01-05 07:30:25 -05:00
Younes Belkada
bf82c9b74f
[BLIP] Fix daily CI failing test (#20877) 2023-01-05 13:24:31 +01:00
Joao Gante
beb24f2a36
Generate: FLAX infers pad token in its absence and has functional example (#21009) 2023-01-05 11:52:58 +00:00
Joao Gante
480799f718
Generate: post-generate config TF doctest fix (#21018) 2023-01-05 11:38:37 +00:00
Steven Liu
8fb4d0e4b4
Fix callback docstrings (#21005) 
* fix callback docstrings

* format as markdown list

* apply feedback
 2023-01-04 12:59:23 -08:00
dependabot[bot]
b7417bee87
Bump gitpython from 3.0.2 to 3.1.30 in /examples/research_projects/distillation (#21011) 
Bump gitpython in /examples/research_projects/distillation

Bumps [gitpython](https://github.com/gitpython-developers/GitPython) from 3.0.2 to 3.1.30.
- [Release notes](https://github.com/gitpython-developers/GitPython/releases)
- [Changelog](https://github.com/gitpython-developers/GitPython/blob/main/CHANGES)
- [Commits](https://github.com/gitpython-developers/GitPython/compare/3.0.2...3.1.30)

---
updated-dependencies:
- dependency-name: gitpython
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-01-04 15:36:42 -05:00
dependabot[bot]
05b736c16e
Bump gitpython from 3.1.18 to 3.1.30 in /examples/research_projects/decision_transformer (#21010) 
Bump gitpython in /examples/research_projects/decision_transformer

Bumps [gitpython](https://github.com/gitpython-developers/GitPython) from 3.1.18 to 3.1.30.
- [Release notes](https://github.com/gitpython-developers/GitPython/releases)
- [Changelog](https://github.com/gitpython-developers/GitPython/blob/main/CHANGES)
- [Commits](https://github.com/gitpython-developers/GitPython/compare/3.1.18...3.1.30)

---
updated-dependencies:
- dependency-name: gitpython
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-01-04 15:36:33 -05:00
Yih-Dar
94db82573e
Fix (DeepSpeed) docker image build issue (#21002) 
* Fix docker image build issue

* remove comment

* Add comment

* Update docker/transformers-pytorch-deepspeed-latest-gpu/Dockerfile

Co-authored-by: Stas Bekman <stas00@users.noreply.github.com>

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
Co-authored-by: Stas Bekman <stas00@users.noreply.github.com>
 2023-01-04 21:28:33 +01:00
Joao Gante
b91048968b
Generate: Fix CI related to #20727 (#21003) 2023-01-04 20:26:56 +00:00