riaz.somc/transformers
1
0
Fork 0
mirror of https://github.com/huggingface/transformers.git synced 2025-07-27 00:09:00 +06:00
Code Issues Actions 27 Packages Projects Releases Wiki Activity
13,508 Commits 888 Branches 231 Tags 2.1 GiB
5dba88b2d2
Commit Graph

79 Commits

Author SHA1 Message Date
Yih-Dar
906afa1d5c
Revert "Unpin protobuf in docker file (for daily CI)" (#24800) 
Revert "Unpin protobuf in docker file (for daily CI) (#24761)"

This reverts commit 45025d92f8.
 2023-07-13 04:19:45 +02:00
Yih-Dar
45025d92f8
Unpin protobuf in docker file (for daily CI) (#24761) 
fix

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2023-07-11 23:55:55 +02:00
ydshieh
66ded238cd fix pydantic install command 2023-07-01 09:29:21 +02:00
Serge Matveenko
d51aa48a76
Limit Pydantic to V1 in dependencies (#24596) 
* Limit Pydantic to V1 in dependencies

Pydantic is about to release V2 release which will break a lot of things. This change prevents `transformers` to be used with Pydantic V2 to avoid breaking things.

* more

---------

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2023-07-01 00:04:03 +02:00
Yih-Dar
17e3e7d686
pin apex to a speicifc commit (for DeepSpeed CI docker image) (#24351) 
* fix

* fix

---------

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2023-06-19 12:48:53 +02:00
Yih-Dar
896a58de15
Byebye pytorch 1.9 (#24080) 
byebye

---------

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2023-06-16 16:38:23 +02:00
Yih-Dar
1f2c00d671
Fix DeepSpeed stuff in the nightly CI (#23478) 
fix

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2023-05-19 20:31:55 +02:00
Yih-Dar
db4d765249
Fix transformers' DeepSpeed CI job (#23463) 
* fix

* fix

---------

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2023-05-19 17:50:06 +02:00
Yih-Dar
22a0769933
Update 3 docker files to use cu118 (#23406) 
* fix

---------

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2023-05-17 14:26:50 +02:00
Yih-Dar
cf11493dce
Use cu118 with cudnn >= 8.6 in docker file (#23339) 
* fix

* fix

---------

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2023-05-12 21:58:15 +02:00
Yih-Dar
8c8744a94a
Fix docker image (caused by tensorflow_text) (#23321) 
fix

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2023-05-12 13:37:37 +02:00
Yih-Dar
ba71d9e94c
unpin tf prob (#23293) 
* unpin tf prob

---------

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2023-05-11 21:28:08 +02:00
Yih-Dar
5f26a23d03
pin tensorflow-probability in docker files (#23260) 
* pong TF prob

* fix

---------

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2023-05-10 16:21:09 +02:00
fxmarty
3042c63a95
Add methods to PreTrainedModel to use PyTorch's BetterTransformer (#21259) 
* fix mess

* better documentation

* typo

* fix doc

* update

* add test

* fix test

* more tests

* Update src/transformers/modeling_utils.py

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* move to utils

* Apply suggestions from code review

Co-authored-by: Michael Benayoun <mickbenayoun@gmail.com>

* nit

---------

Co-authored-by: younesbelkada <younesbelkada@gmail.com>
Co-authored-by: Younes Belkada <49240599+younesbelkada@users.noreply.github.com>
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
Co-authored-by: Michael Benayoun <mickbenayoun@gmail.com>
 2023-04-27 11:03:42 +02:00
Yih-Dar
073baf7f22
Install accelerete@main in PyTorch Past CI jobs (#22963) 
fix

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2023-04-24 21:19:06 +02:00
Yih-Dar
4603fe9b1f
use accelerate@main in CI (#22859) 
fix

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2023-04-19 14:58:53 +02:00
Yih-Dar
656d41ab4c
Remove DS_BUILD_AIO=1 (#22741) 
fix

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2023-04-13 18:08:22 +02:00
Yih-Dar
0fe6c6bdca
(Re-)Enable Nightly + Past CI (#22393) 
* Enable Nightly + Past CI

* put schedule

---------

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2023-03-30 21:06:35 +02:00
Yih-Dar
01203475c9
Update docker files to use official torch 2.0.0 (#22357) 
* update docker files to use official torch 2.0.0

---------

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2023-03-24 14:29:05 +01:00
Yih-Dar
bec075612a
Revert "Use dash==2.8.1 for now for daily CI" (#22233) 
Revert "Use `dash==2.8.1` for now for daily CI (#22227)"

This reverts commit 53218671d9.
 2023-03-17 16:54:27 +01:00
Yih-Dar
53218671d9
Use dash==2.8.1 for now for daily CI (#22227) 
Use dash 2.8.1 for now

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2023-03-17 13:27:14 +01:00
Yih-Dar
1c4a9acc73
Fix DeepSpeed CI (#22194) 
* Deal with torch-tensorrt

---------

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2023-03-16 05:52:40 +01:00
Yih-Dar
ba9e0191de
Prepare daily CI for torch 2.0.0 (#22135) 
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2023-03-13 22:21:15 +01:00
amyeroberts
3412f5979d
Use PyAV instead of Decord in examples (#21572) 
* Use PyAV instead of Decord

* Get frame indices

* Fix number of frames

* Update src/transformers/models/videomae/image_processing_videomae.py

* Fix up

* Fix copies

* Update timesformer doctests

* Update docstrings
 2023-03-02 12:30:38 +00:00
Yih-Dar
db572b3854
Use torch 1.13.1 in push/schedule CI (#21421) 
Use torch 1.13.1 in push/scheduled CI

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2023-02-02 14:58:52 +01:00
Yih-Dar
94db82573e
Fix (DeepSpeed) docker image build issue (#21002) 
* Fix docker image build issue

* remove comment

* Add comment

* Update docker/transformers-pytorch-deepspeed-latest-gpu/Dockerfile

Co-authored-by: Stas Bekman <stas00@users.noreply.github.com>

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
Co-authored-by: Stas Bekman <stas00@users.noreply.github.com>
 2023-01-04 21:28:33 +01:00
Yih-Dar
1543cee7c8
Recompile apex in DeepSpeed CI image (#20788) 
Recompile apex in DeepSpeed CI image

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2022-12-15 21:35:27 +01:00
Yih-Dar
b1706f6908
Install video dependency for pipeline CI (#20777) 
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2022-12-15 18:47:05 +01:00
Yih-Dar
94f8e21c70
Install torch-tensorrt 1.3.0 for DeepSpeed CI (#20764) 
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2022-12-14 17:30:36 +01:00
Yih-Dar
d994473b05
Uninstall torch_tensorrt in DeepSpeed CI image for now (#20758) 
Uninstall torch_tensorrt for now

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2022-12-13 22:25:47 +01:00
Yih-Dar
d4bf9ee1ff
Update CI to torch 1.13.0 (#20687) 
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2022-12-12 20:04:56 +01:00
Yih-Dar
147fa37fb1
pin TF 2.11 in docker files (#20642) 
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2022-12-07 15:46:48 +01:00
Yih-Dar
f68796bd60
Fix natten installation in docker file (#20632) 
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2022-12-06 22:23:06 +01:00
Yih-Dar
91182e3a70
Install tensorflow_probability for TF pipeline CI (#20586) 
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2022-12-05 16:07:25 +01:00
Yih-Dar
8639cfb4c2
Install natten with CUDA version (#20546) 
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2022-12-05 15:08:32 +01:00
Yih-Dar
dd6fb1319b
Add natten for CI (#20511) 
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2022-11-30 19:49:34 +01:00
Yih-Dar
f10cdba22e
Pin TF 2.10.1 for Push CI (#20319) 
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2022-11-18 18:24:35 +01:00
Bartosz Szmelczynski
78a471ff71
Fix tapas scatter (#20149) 
* First draft

* Remove scatter dependency

* Add require_torch

* update vectorized sum test, add clone call

* remove artifacts

* fix style

* fix style v2

* remove "scatter" mentions from the code base

* fix isort error

Co-authored-by: Niels Rogge <nielsrogge@Nielss-MacBook-Pro.local>
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2022-11-14 01:04:26 -05:00
raghavanone
7829c890db
Change the import of kenlm from github to pypi (#19770) 
* Change the import of kenlm from github to pypi

* Change the import of kenlm from github to pypi in circleci config

* Fix code quality issues

* Fix isort issue, add kenlm in extras for audio

* Add kenlm to deps

* Add kenlm to deps

* Commit 'make fixup' changes

* Remove version from kenlm deps

* commit make fixup changes

* Remove manual installation of kenlm

* Remove manual installation of kenlm

* Remove manual installation of kenlm
 2022-10-26 17:06:46 +02:00
Yih-Dar
15fd39ea0e
Install tf2onnx dev version (#19755) 
* pin tf2onnx<=1.12.0

* Install tf2onnx main

* Pin to a specific commit

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2022-10-20 20:24:39 +02:00
Yih-Dar
d7dc774a79
Fix TFGroupViT CI (#19461) 
* Fix TFGroupViT CI

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2022-10-11 14:29:15 +02:00
Yih-Dar
16242e1bf0
Run torchdynamo tests (#19056) 
* Enable torchdynamo tests

* make style

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2022-09-15 11:10:16 -07:00
Joao Gante
1182b945a6
TF: TF 2.10 unpin + related onnx test skips (#18995) 2022-09-12 19:30:27 +01:00
Sylvain Gugger
a26114777e
Revert "TF: unpin maximum TF version (#18917)" (#18972) 
This reverts commit d8cf3b2087.
 2022-09-10 09:11:46 -04:00
Joao Gante
d8cf3b2087
TF: unpin maximum TF version (#18917) 2022-09-10 13:33:01 +01:00
Yih-Dar
6690ba3f4d
pin TF 2.9.1 for self-hosted CIs (#18925) 
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2022-09-07 19:46:14 +02:00
Yih-Dar
ecdf9b06bc
Remove cached torch_extensions on CI runners (#18868) 
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2022-09-02 18:17:58 +02:00
Yih-Dar
84beb8a49b
Unpin detectron2 (#18727) 
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2022-08-23 11:10:07 +02:00
Yih-Dar
30992ef0d9
[Hotfix] pin detectron2 5aeb252 to avoid test fix (#18701) 
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2022-08-20 00:37:38 +02:00
Younes Belkada
6d175c1129
[bnb] Minor modifications (#18631) 
* bnb minor modifications

- refactor documentation
- add troubleshooting README
- add PyPi library on DockerFile

* Apply suggestions from code review

Co-authored-by: Stas Bekman <stas00@users.noreply.github.com>

* Apply suggestions from code review

* Apply suggestions from code review

* Apply suggestions from code review

* put in one block

- put bash instructions in one block

* update readme

- refactor a bit hardware requirements

* change text a bit

* Apply suggestions from code review

Co-authored-by: Yih-Dar <2521628+ydshieh@users.noreply.github.com>

* apply suggestions

Co-authored-by: Yih-Dar <2521628+ydshieh@users.noreply.github.com>

* add link to paper

* Apply suggestions from code review

Co-authored-by: Stas Bekman <stas00@users.noreply.github.com>

* Update tests/mixed_int8/README.md

* Apply suggestions from code review

* refactor a bit

* add instructions Turing & Amperer

Co-authored-by: Stas Bekman <stas00@users.noreply.github.com>

* add A6000

* clarify a bit

* remove small part

* Update tests/mixed_int8/README.md

Co-authored-by: Stas Bekman <stas00@users.noreply.github.com>
Co-authored-by: Yih-Dar <2521628+ydshieh@users.noreply.github.com>
 2022-08-17 00:48:10 +02:00