riaz.somc/transformers
1
0
Fork 0
mirror of https://github.com/huggingface/transformers.git synced 2025-07-31 18:22:34 +06:00
Code Issues Actions 4 Packages Projects Releases Wiki Activity

Sagemaker test fix (#10987)

Browse Source 
* wrong makefile command

* ddp test fix
This commit is contained in:
Philipp Schmid 2021-03-31 13:44:22 +02:00 committed by GitHub
parent 645f45c462
commit ced7284a60
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
2 changed files with 3 additions and 3 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
tests/sagemaker/README.md
View File

@ -18,7 +18,7 @@ git+https://github.com/huggingface/transformers.git@v4.5.0.rc0 # install master
After we adjusted the `requirements.txt` we can run Amazon SageMaker tests with: After we adjusted the `requirements.txt` we can run Amazon SageMaker tests with:
```bash ```bash
AWS_PROFILE=<enter-your-profile> make sagemaker-test AWS_PROFILE=<enter-your-profile> make test-sagemaker
``` ```
These tests take around 10-15 minutes to finish. Preferably make a screenshot of the successfully ran tests. These tests take around 10-15 minutes to finish. Preferably make a screenshot of the successfully ran tests.
@ -88,7 +88,7 @@ tensorflow-gpu==2.5.0 # for tensorflow
After we adjusted the `requirements.txt` we can run Amazon SageMaker tests with. After we adjusted the `requirements.txt` we can run Amazon SageMaker tests with.
```bash ```bash
AWS_PROFILE=<enter-your-profile> make sagemaker-test AWS_PROFILE=<enter-your-profile> make test-sagemaker
``` ```
These tests take around 10-15 minutes to finish. Preferably make a screenshot of the successfully ran tests. These tests take around 10-15 minutes to finish. Preferably make a screenshot of the successfully ran tests.

2
tests/sagemaker/test_multi_node_data_parallel.py
View File

@ -58,7 +58,7 @@ class MultiNodeTest(unittest.TestCase):
def create_estimator(self, instance_count): def create_estimator(self, instance_count):
job_name = f"{self.env.base_job_name}-{instance_count}-{'ddp' if 'ddp' in self.script else 'smd'}" job_name = f"{self.env.base_job_name}-{instance_count}-{'ddp' if 'ddp' in self.script else 'smd'}"
# distributed data settings # distributed data settings
distribution = {"smdistributed": {"dataparallel": {"enabled": True}}} distribution = {"smdistributed": {"dataparallel": {"enabled": True}}} if self.script != "run_ddp.py" else None
# creates estimator # creates estimator
return HuggingFace( return HuggingFace(