transformers/tests/deepspeed
Ella Charlaix 39acfe84ba
Add deepspeed test to amd scheduled CI (#27633)
* add deepspeed scheduled test for amd

* fix image

* add dockerfile

* add comment

* enable tests

* trigger

* remove trigger for this branch

* trigger

* change runner env to trigger the docker build image test

* use new docker image

* remove test suffix from docker image tag

* replace test docker image with original image

* push new image

* Trigger

* add back amd tests

* fix typo

* add amd tests back

* fix

* comment until docker image build scheduled test fix

* remove deprecated deepspeed build option

* upgrade torch

* update docker & make tests pass

* Update docker/transformers-pytorch-deepspeed-amd-gpu/Dockerfile

* fix

* tmp disable test

* precompile deepspeed to avoid timeout during tests

* fix comment

* trigger deepspeed tests with new image

* comment tests

* trigger

* add sklearn dependency to fix slow tests

* enable back other tests

* final update

---------

Co-authored-by: Felix Marty <felix@hf.co>
Co-authored-by: Félix Marty <9808326+fxmarty@users.noreply.github.com>
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
2023-12-11 16:33:36 +01:00
..
ds_config_zero2.json [Deepspeed] add support for bf16 mode (#14569) 2022-03-11 17:53:53 -08:00
ds_config_zero3.json [Deepspeed] add support for bf16 mode (#14569) 2022-03-11 17:53:53 -08:00
test_deepspeed.py Add deepspeed test to amd scheduled CI (#27633) 2023-12-11 16:33:36 +01:00
test_model_zoo.py Apply ruff flake8-comprehensions (#21694) 2023-02-22 09:14:54 +01:00
vit_feature_extractor.json missing file (#17164) 2022-05-10 10:19:50 -07:00