riaz.somc/transformers
1
0
Fork 0
mirror of https://github.com/huggingface/transformers.git synced 2025-07-14 10:08:29 +06:00
Code Issues Actions 8 Packages Projects Releases Wiki Activity
15,053 Commits 864 Branches 226 Tags 2 GiB
3f9f749325
Commit Graph

15053 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Zach Mueller
a6609caf4e
More frozen args (#25540) 2023-08-16 12:19:51 -04:00
Yih-Dar
f61f072b61
Fix MaskFormerModelIntegrationTest OOM (#25544) 
fix

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2023-08-16 18:11:24 +02:00
Marc Sun
0ed23e4db2
fix vit hybrid test (#25543) 
fix test
 2023-08-16 17:02:57 +02:00
Joao Gante
3f9cb33504
Generate: fix default max length warning (#25539) 2023-08-16 15:30:54 +01:00
Sylvain Gugger
e13d5b6048
Document the test fetcher (#25521) 
* Document the test fetcher

* Address review comments
 2023-08-16 14:18:32 +02:00
Joao Gante
0b568291d7
Marian: post-hack-fix correction (#25459) 2023-08-16 11:49:29 +01:00
Sylvain Gugger
5ccf343aeb
Fix nested configs of Jukebox (#25533) 2023-08-16 11:48:24 +02:00
lishukan
c385de2441
[TYPO] fix typo/format in quicktour.md (#25519) 
* fix_all_language_quicktour

* give up ! before bash command

---------

Co-authored-by: lishukan <lishukan@dxy.cn>
 2023-08-16 08:03:23 +02:00
Matt
eec5841e9f
Use dynamic past key-values shape in TF-Whisper (#25523) 2023-08-15 17:57:58 +01:00
Zach Mueller
ca51499248
Make training args fully immutable (#25435) 
* Make training args fully immutable

* Working tests, PyTorch

* In test_trainer

* during testing

* Use proper dataclass way

* Fix test

* Another one

* Fix tf

* Lingering slow

* Exception

* Clean
 2023-08-15 11:47:47 -04:00
YQ
f11518a542
add __repr__ to the BitsAndBytesConfig class (#25517) 
add __repr__
 2023-08-15 11:11:28 +02:00
dependabot[bot]
7a94ea4c64
Bump tornado from 6.3.2 to 6.3.3 in /examples/research_projects/lxmert (#25511) 
Bumps [tornado](https://github.com/tornadoweb/tornado) from 6.3.2 to 6.3.3.
- [Changelog](https://github.com/tornadoweb/tornado/blob/master/docs/releases.rst)
- [Commits](https://github.com/tornadoweb/tornado/compare/v6.3.2...v6.3.3)

---
updated-dependencies:
- dependency-name: tornado
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-08-15 08:52:30 +02:00
dependabot[bot]
2552b8c5bd
Bump tornado from 6.3.2 to 6.3.3 in /examples/research_projects/visual_bert (#25512) 
Bump tornado in /examples/research_projects/visual_bert

Bumps [tornado](https://github.com/tornadoweb/tornado) from 6.3.2 to 6.3.3.
- [Changelog](https://github.com/tornadoweb/tornado/blob/master/docs/releases.rst)
- [Commits](https://github.com/tornadoweb/tornado/compare/v6.3.2...v6.3.3)

---
updated-dependencies:
- dependency-name: tornado
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-08-15 08:52:20 +02:00
Michael Murray
df91ff5314
Check for case where auxiliary_head is None in UperNetPreTrainedModel (#25514) 
check for case where auxiliary_head is None in UperNetPreTrainedModel
 2023-08-15 08:44:21 +02:00
Matt
b42010bb1d
Conditional DETR type hint fix (#25505) 2023-08-14 18:12:06 +01:00
amyeroberts
c41291965f
🚨🚨🚨 Remove softmax for EfficientNetForImageClassification 🚨🚨🚨 (#25501) 
* Remove softmax for EfficientNet

* Update integration test values

* Fix up
 2023-08-14 17:08:47 +01:00
Marc Sun
06a1d75bd5
fix gptq nits (#25500) 
* fix nits

* fix docstring

* fix doc

* fix damp_percent

* fix doc
 2023-08-14 11:43:38 -04:00
amyeroberts
80f29a25a7
MaskFormer post_process_instance_segmentation bug fix convert out side of loop (#25497) 
Bug fix - convert out side of loop
 2023-08-14 16:00:57 +01:00
Yoach Lacombe
ee7d6694ed
Set can_generate for SpeechT5ForTextToSpeech (#25493) 
add can_generate=True to SpeechT5ForTextToSpeech
 2023-08-14 15:41:47 +01:00
David Reguera
87c9d8a10f
Add type hints to Blip2QFormer, BigBirdForQA and ConditionalDetr family models (#25488) 
* Add missing type hints to `BigBirdForQuestionAnswering`

* Add type hints to `Blip2QFormerModel`

* Add type hints for `ConditionalDetr` family
 2023-08-14 14:44:34 +01:00
Matt
b1b0fc4f56
Remove logging code in TF Longformer that fails to compile (#25496) 
Remove wonky logger block
 2023-08-14 14:22:15 +01:00
nour-elkamel
e97deca9a3
fix : escape key of start_token from special characters before search end_token in token2json function of DonutProcessor (#25472) 
fix : escape key of start_token from special characters before searching for end_token
 2023-08-14 13:46:17 +02:00
dependabot[bot]
0ebe7ae160
Bump gitpython from 3.1.30 to 3.1.32 in /examples/research_projects/decision_transformer (#25467) 
Bump gitpython in /examples/research_projects/decision_transformer

Bumps [gitpython](https://github.com/gitpython-developers/GitPython) from 3.1.30 to 3.1.32.
- [Release notes](https://github.com/gitpython-developers/GitPython/releases)
- [Changelog](https://github.com/gitpython-developers/GitPython/blob/main/CHANGES)
- [Commits](https://github.com/gitpython-developers/GitPython/compare/3.1.30...3.1.32)

---
updated-dependencies:
- dependency-name: gitpython
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-08-13 19:47:16 +02:00
dependabot[bot]
2b22cde71e
Bump gitpython from 3.1.30 to 3.1.32 in /examples/research_projects/distillation (#25468) 
Bump gitpython in /examples/research_projects/distillation

Bumps [gitpython](https://github.com/gitpython-developers/GitPython) from 3.1.30 to 3.1.32.
- [Release notes](https://github.com/gitpython-developers/GitPython/releases)
- [Changelog](https://github.com/gitpython-developers/GitPython/blob/main/CHANGES)
- [Commits](https://github.com/gitpython-developers/GitPython/compare/3.1.30...3.1.32)

---
updated-dependencies:
- dependency-name: gitpython
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-08-13 19:47:04 +02:00
Erfan Zekri Esfahani
892f9ea0db
import required torch and numpy libraries (#25483) 2023-08-13 19:26:40 +02:00
Yih-Dar
fe3c8ab1af
Revert "Reuse the cache created for latest main on PRs/branches" (#25466) 
Revert "Reuse the cache created for latest `main` on PRs/branches if `setup.py` is not modified (#25445)"

This reverts commit 1d75768695.
 2023-08-11 21:07:08 +02:00
amyeroberts
5e5fa0d88c
Mark flaky tests (#25463) 
Make CI less brittle
 2023-08-11 15:26:45 +01:00
amyeroberts
11757e2bbd
Add input_data_format argument, image transforms (#25462) 
* Enable specifying input data format - overriding inferring

* Add tests
 2023-08-11 15:09:31 +01:00
Gema Parreño
0acf56224b
Update run_translation.py broken link example Pytoch (#25461) 
* Update run_translation.py

Fixed link

* Update run_translation.py
 2023-08-11 15:41:24 +02:00
Yih-Dar
1d75768695
Reuse the cache created for latest main on PRs/branches if setup.py is not modified (#25445) 
* fix

* fix

* fix

---------

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2023-08-11 14:40:51 +02:00
Joao Gante
4692d26194
Switch Transformers: remove overwritten beam sample test (#25458) 2023-08-11 13:16:01 +01:00
amyeroberts
41d56ea6dd
Refactor image processor testers (#25450) 
* Refactor image processor test mixin

- Move test_call_numpy, test_call_pytorch, test_call_pil to mixin
- Rename mixin to reflect handling of logic more than saving
- Add prepare_image_inputs, expected_image_outputs for tests

* Fix for oneformer
 2023-08-11 11:30:18 +01:00
Yih-Dar
454957c9bb
Fix for #25437 (#25454) 
* fix

* fix

* fix

* fix

* fix

* fix

---------

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2023-08-11 11:39:57 +02:00
Marc Sun
55db70c63d
GPTQ integration (#25062) 
* GTPQ integration

* Add tests for gptq

* support for more quantization model

* fix style

* typo

* fix method

* Update src/transformers/modeling_utils.py

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* add dataclass and fix quantization_method

* fix doc

* Update tests/quantization/gptq/test_gptq.py

Co-authored-by: Younes Belkada <49240599+younesbelkada@users.noreply.github.com>

* Apply suggestions from code review

Co-authored-by: Younes Belkada <49240599+younesbelkada@users.noreply.github.com>

* modify dataclass

* add gtpqconfig import

* fix typo

* fix tests

* remove dataset as req arg

* remove tokenizer import

* add offload cpu quantization test

* fix check dataset

* modify dockerfile

* protect trainer

* style

* test for config

* add more log

* overwrite torch_dtype

* draft doc

* modify quantization_config docstring

* fix class name in docstring

* Apply suggestions from code review

Co-authored-by: Younes Belkada <49240599+younesbelkada@users.noreply.github.com>

* more warning

* fix 8bit kwargs tests

* peft compatibility

* remove var

* fix is_gptq_quantized

* remove is_gptq_quantized

* fix wrap

* Update src/transformers/modeling_utils.py

Co-authored-by: Younes Belkada <49240599+younesbelkada@users.noreply.github.com>

* add exllama

* skip test

* overwrite float16

* style

* fix skip test

* Apply suggestions from code review

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* fix docsting formatting

* add doc

* better test

---------

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
Co-authored-by: Younes Belkada <49240599+younesbelkada@users.noreply.github.com>
 2023-08-10 16:06:29 -04:00
Alan Ji
347001237a
docs: add LLaMA-Efficient-Tuning to awesome-transformers (#25441) 
Co-authored-by: statelesshz <jihuazhong1@huawei.com>
 2023-08-10 17:13:39 +02:00
Zach Mueller
a7da2996a0
Fix issue with ratio evaluation steps and auto find batch size (#25436) 
* Fully rebased solution

* 500
 2023-08-10 11:07:32 -04:00
Yih-Dar
2d6839eaa6
Add examples to tests to run when setup.py is modified (#25437) 
fix

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2023-08-10 16:42:05 +02:00
Merve Noyan
e7b001db4f
Fix rendering for torch.compile() docs (#25432) 
fix rendering
 2023-08-10 13:25:00 +02:00
Joao Gante
3e41cf13fc
Generate: Load generation config when device_map is passed (#25413) 2023-08-10 10:54:26 +01:00
Sanchit Gandhi
d0839f1a74
[WavLM] Fix Arxiv link and authors (#25415) 
* [WavLM] Fix Arxiv link and authors

* make style
 2023-08-10 10:50:12 +01:00
Joao Gante
123ad5363f
Generation: strict generation config validation at save time (#25411) 
* strict gen config save; Add tests

* add note that the warning will be an exception in v4.34
 2023-08-10 10:42:34 +01:00
Sylvain Gugger
16edf4d9fd
Doc checks (#25408) 
* Document check_dummies

* Type hints and doc in other files

* Document check inits

* Add documentation to

* Address review comments
 2023-08-10 10:53:22 +02:00
TaeYupNoh
b14d4641f6
🌐 [i18n-KO] Translated philosophy.md to Korean (#25010) 
* docs: ko: philosophy.md

* feat: chatgpt draft

* fix: manual edits

* fix: resolve suggestions
 2023-08-10 09:50:51 +02:00
NielsRogge
b175fc39d9
[DINOv2] Update pooler output (#25392) 
Update pooler output
 2023-08-10 09:13:52 +02:00
Joao Gante
d0c1aebea4
Bark: flexible generation config overload (#25414) 2023-08-09 18:51:51 +01:00
amyeroberts
944ddce8bf
Enable passing number of channels when inferring data format (#25412) 2023-08-09 17:41:21 +01:00
hukuda222
cb3c821cb7
aligned sample_beam output selection with beam_search (#25375) 
* aligned sample_beam specs with beam_search

* pull origin main

* Revert "pull origin main"

This reverts commit 06d356f113.

* update test_utils.py

* fix format

* remove comment

---------

Co-authored-by: Shogo Fujita <shogo.fujita@legalontech.jp>
 2023-08-09 18:28:57 +02:00
Yoach Lacombe
704bf595eb
Update Bark generation configs and tests (#25409) 
* update bark generation configs for more coherent parameter

* make style

* update bark hub repo
 2023-08-09 18:28:02 +02:00
Hyeonseo Yun
cf84738d2e
🌐 [i18n-KO] Translated model_summary.md to Korean (#24625) 
* docs: ko: model_summary.md

* feat: nmt and manual edit model_summary.mdx

* fix: resolve suggestions

Co-authored-by: Sohyun Sim <96299403+sim-so@users.noreply.github.com>
Co-authored-by: Wonhyeong Seo <wonhseo@kakao.com>

* fix: resolve suggestions2

Co-authored-by: Sohyun Sim <96299403+sim-so@users.noreply.github.com>

---------

Co-authored-by: Sohyun Sim <96299403+sim-so@users.noreply.github.com>
Co-authored-by: Wonhyeong Seo <wonhseo@kakao.com>
 2023-08-09 18:27:27 +02:00
MinJae Kang
133aac09b0
🌐 [i18n-KO] Translated add_new_model.md to Korean (#24957) 
* docs: ko: add_new_model.md

* feat: chatgpt draft

* fix: manual edits

* fix: change document title

* fix: edit with reviewers

Co-authored-by: Jungnerd <46880056+jungnerd@users.noreply.github.com>

* fix: edit with reviewers

Co-authored-by: Jungnerd <46880056+jungnerd@users.noreply.github.com>

* fix: edit with reviewers

Co-authored-by: Jungnerd <46880056+jungnerd@users.noreply.github.com>

* fix: edit with reviewers

Co-authored-by: Jungnerd <46880056+jungnerd@users.noreply.github.com>

* fix: edit with reviewers

Co-authored-by: SeongWooChoi <46990061+nuatmochoi@users.noreply.github.com>

* fix: edit with reviewers

Co-authored-by: SeongWooChoi <46990061+nuatmochoi@users.noreply.github.com>

* fix: edit with reviewers

Co-authored-by: SeongWooChoi <46990061+nuatmochoi@users.noreply.github.com>

* fix: edit with reviewers

Co-authored-by: Jungnerd <46880056+jungnerd@users.noreply.github.com>

* fix: add anchor to header

* Update docs/source/ko/add_new_model.md

Co-authored-by: 이서정 <97655267+sjlee-wise@users.noreply.github.com>

* Update docs/source/ko/add_new_model.md

Co-authored-by: 이서정 <97655267+sjlee-wise@users.noreply.github.com>

* Update docs/source/ko/add_new_model.md

Co-authored-by: 이서정 <97655267+sjlee-wise@users.noreply.github.com>

* fix: edit with reviews

* feat: edit toctree

---------

Co-authored-by: Wonhyeong Seo <wonhseo@kakao.com>
Co-authored-by: Jungnerd <46880056+jungnerd@users.noreply.github.com>
Co-authored-by: SeongWooChoi <46990061+nuatmochoi@users.noreply.github.com>
Co-authored-by: 이서정 <97655267+sjlee-wise@users.noreply.github.com>
 2023-08-09 18:24:29 +02:00