mirror of
https://github.com/huggingface/transformers.git
synced 2025-07-31 02:02:21 +06:00
9ba021ea75
* clean mimi commit * some nits suggestions from Arthur * make fixup * first moshi WIP * converting weights working + configuration + generation configuration * finalize converting script - still missing tokenizer and FE and processor * fix saving model w/o default config * working generation * use GenerationMixin instead of inheriting * add delay pattern mask * fix right order: moshi codes then user codes * unconditional inputs + generation config * get rid of MoshiGenerationConfig * blank user inputs * update convert script:fix conversion, add tokenizer, feature extractor and bf16 * add and correct Auto classes * update modeling code, configuration and tests * make fixup * fix some copies * WIP: add integration tests * add dummy objects * propose better readiblity and code organisation * update tokenization tests * update docstrigns, eval and modeling * add .md * make fixup * add MoshiForConditionalGeneration to ignore Auto * revert mimi changes * re * further fix * Update moshi.md * correct md formating * move prepare causal mask to class * fix copies * fix depth decoder causal * fix and correct some tests * make style and update .md * correct config checkpoitn * Update tests/models/moshi/test_tokenization_moshi.py Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com> * Update tests/models/moshi/test_tokenization_moshi.py Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com> * make style * Update src/transformers/models/moshi/__init__.py Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com> * fixup * change firm in copyrights * udpate config with nested dict * replace einsum * make style * change split to True * add back splt=False * remove tests in convert * Update tests/models/moshi/test_modeling_moshi.py Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com> * add default config repo + add model to FA2 docstrings * remove logits float * fix some tokenization tests and ignore some others * make style tokenization tests * update modeling with sliding window + update modeling tests * [run-slow] moshi * remove prepare for generation frol CausalLM * isort * remove copied from * ignore offload tests * update causal mask and prepare 4D mask aligned with recent changes * further test refine + add back prepare_inputs_for_generation for depth decoder * correct conditional use of prepare mask * update slow integration tests * fix multi-device forward * remove previous solution to device_map * save_load is flaky * fix generate multi-devices * fix device * move tensor to int --------- Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com> Co-authored-by: Marc Sun <marc@huggingface.co> |
||
|---|---|---|
| .. | ||
| test_module | ||
| tf_ops | ||
| add_pipeline_model_mapping_to_test.py | ||
| check_build.py | ||
| check_config_attributes.py | ||
| check_config_docstrings.py | ||
| check_copies.py | ||
| check_doc_toc.py | ||
| check_docstrings.py | ||
| check_doctest_list.py | ||
| check_dummies.py | ||
| check_inits.py | ||
| check_model_tester.py | ||
| check_modular_conversion.py | ||
| check_repo.py | ||
| check_self_hosted_runner.py | ||
| check_support_list.py | ||
| check_table.py | ||
| check_tf_ops.py | ||
| create_dependency_mapping.py | ||
| create_dummy_models.py | ||
| custom_init_isort.py | ||
| deprecate_models.py | ||
| download_glue_data.py | ||
| extract_warnings.py | ||
| get_ci_error_statistics.py | ||
| get_github_job_time.py | ||
| get_modified_files.py | ||
| get_previous_daily_ci.py | ||
| get_test_info.py | ||
| important_models.txt | ||
| models_to_deprecate.py | ||
| modular_model_converter.py | ||
| not_doctested.txt | ||
| notification_service_doc_tests.py | ||
| notification_service_quantization.py | ||
| notification_service.py | ||
| past_ci_versions.py | ||
| patch_helper.py | ||
| pr_slow_ci_models.py | ||
| print_env.py | ||
| process_test_artifacts.py | ||
| release.py | ||
| set_cuda_devices_for_ci.py | ||
| slow_documentation_tests.txt | ||
| sort_auto_mappings.py | ||
| split_doctest_jobs.py | ||
| split_model_tests.py | ||
| tests_fetcher.py | ||
| update_metadata.py | ||
| update_tiny_models.py | ||