mirror of
https://github.com/huggingface/transformers.git
synced 2025-07-03 12:50:06 +06:00
![]() * Get parallel loader working. Include tests. * Update the tests for parallel loading * Rename env variables. * Add docs for parallel model weight loading. * Touch up parallel model loading docs. * Touch up parallel model loading docs again. * Edit comment in test_modeling_utils_parallel_loading.py * Make sure HF_PARALLEL_LOADING_WORKERS is spelled correctly in modeling_utils.py * Correct times for parallelized loading, previous times were for a "hot" filesystem * Update parallel model loading so the spawn method is encapsulated. DRY up the code by leveraging get_submodule. * Update docs on model loading parallelism so that details on setting the multiprocessing start method are removed, now that the package handles this step internally. * Fix style on model loading parallelism changes. * Merge latest version of master's modeling_utils. * Removed unused variable. * Fix argument packing for the parallel loader. * Fix state dict being undefined in the parallel model loader. * Rename variables used in parallel model loading for clarity. Use get_module_from_name(). * Switch to the use of threads for parallel model loading. * Update docs for parallel loading. * Remove the use of json.loads when evaluating HF_ENABLE_PARALLEL_LOADING. Prefer simple casting. * Move parallelized shard loading into its own function. * Remove use of is_true(). Favor checking env var true values for HF_ENABLE_PARALLEL_LOADING. * Update copyright to 2025 in readme for paralell model loading. * Remove garbage collection line in load_shard_file, implicit garbage collection already occurs. * Run formatter on modeling_utils.py * Apply style fixes * Delete tests/utils/test_modeling_utils_parallel_loading.py --------- Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: Cyril Vallez <cyril.vallez@huggingface.co> |
||
---|---|---|
.. | ||
import_structures | ||
__init__.py | ||
test_activations_tf.py | ||
test_activations.py | ||
test_add_new_model_like.py | ||
test_audio_utils.py | ||
test_auto_docstring.py | ||
test_backbone_utils.py | ||
test_cache_utils.py | ||
test_chat_template_utils.py | ||
test_cli.py | ||
test_configuration_utils.py | ||
test_convert_slow_tokenizer.py | ||
test_deprecation.py | ||
test_doc_samples.py | ||
test_dynamic_module_utils.py | ||
test_expectations.py | ||
test_feature_extraction_utils.py | ||
test_file_utils.py | ||
test_generic.py | ||
test_hf_argparser.py | ||
test_hub_utils.py | ||
test_image_processing_utils.py | ||
test_image_utils.py | ||
test_import_structure.py | ||
test_import_utils.py | ||
test_logging.py | ||
test_model_card.py | ||
test_model_debugging_utils.py | ||
test_model_output.py | ||
test_modeling_flax_utils.py | ||
test_modeling_rope_utils.py | ||
test_modeling_tf_core.py | ||
test_modeling_tf_utils.py | ||
test_modeling_utils.py | ||
test_offline.py | ||
test_processing_utils.py | ||
test_skip_decorators.py | ||
test_tokenization_utils.py | ||
test_versions_utils.py | ||
test_video_utils.py | ||
tiny_model_summary.json |