riaz.somc/transformers
1
0
Fork 0
mirror of https://github.com/huggingface/transformers.git synced 2025-07-03 04:40:06 +06:00
Code Issues Actions 28 Packages Projects Releases Wiki Activity

log: Add logging when using split_batches and per_device_train_batch_size (#38633)

Browse Source 
* log: Add logging when user uses split_batches and per_device_train_batch_size

* refactor: remove whitespace from blank line

* Update src/transformers/training_args.py

Change logging level to info

Co-authored-by: Marc Sun <57196510+SunMarc@users.noreply.github.com>

---------

Co-authored-by: Marc Sun <57196510+SunMarc@users.noreply.github.com>
This commit is contained in:
Keshav Singh 2025-06-19 01:26:46 +09:00 committed by GitHub
parent c55d806355
commit 0a289d1630
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 5 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

5
src/transformers/training_args.py
View File

@ -1753,6 +1753,11 @@ class TrainingArguments:
)
else:
self.accelerator_config = AcceleratorConfig.from_json_file(self.accelerator_config)
if self.accelerator_config.split_batches:
logger.info(
"Using `split_batches=True` in `accelerator_config` will override the `per_device_train_batch_size` "
"Batches will be split across all processes equally when using `split_batches=True`."
)
# Initialize device before we proceed
if self.framework == "pt" and is_torch_available():