mirror of
https://github.com/huggingface/transformers.git
synced 2025-07-04 13:20:12 +06:00
c33f6046c3
* add seed worker and set_deterministic_seed_for_cuda function to enforce reproducability * change function name to enable determinism, add docstrings, reproducability support for tf * change function name to enable_determinism_for_distributed_training * revert changes in set_seed and call set_seed within enable_full_determinism * add one position argument for seed_worker function * add full_determinism flag in training args and call enable_full_determinism when it is true * add enable_full_determinism to documentation * apply make fixup after the last commit * Update src/transformers/training_args.py Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com> Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
46 lines
1.2 KiB
Plaintext
46 lines
1.2 KiB
Plaintext
<!--Copyright 2020 The HuggingFace Team. All rights reserved.
|
|
|
|
Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with
|
|
the License. You may obtain a copy of the License at
|
|
|
|
http://www.apache.org/licenses/LICENSE-2.0
|
|
|
|
Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on
|
|
an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the
|
|
specific language governing permissions and limitations under the License.
|
|
-->
|
|
|
|
# Utilities for Trainer
|
|
|
|
This page lists all the utility functions used by [`Trainer`].
|
|
|
|
Most of those are only useful if you are studying the code of the Trainer in the library.
|
|
|
|
## Utilities
|
|
|
|
[[autodoc]] EvalPrediction
|
|
|
|
[[autodoc]] IntervalStrategy
|
|
|
|
[[autodoc]] enable_full_determinism
|
|
|
|
[[autodoc]] set_seed
|
|
|
|
[[autodoc]] torch_distributed_zero_first
|
|
|
|
## Callbacks internals
|
|
|
|
[[autodoc]] trainer_callback.CallbackHandler
|
|
|
|
## Distributed Evaluation
|
|
|
|
[[autodoc]] trainer_pt_utils.DistributedTensorGatherer
|
|
|
|
## Distributed Evaluation
|
|
|
|
[[autodoc]] HfArgumentParser
|
|
|
|
## Debug Utilities
|
|
|
|
[[autodoc]] debug_utils.DebugUnderflowOverflow
|