mirror of
https://github.com/huggingface/transformers.git
synced 2025-07-15 10:38:23 +06:00
ae1f835028
* Init PLBART * Add missing configuration file * Add conversion script and configurationf ile * Fix style * Update modeling and conversion scripts * Fix scale embedding in config * Add comment * Fix conversion script * Add classification option to conversion script * Fix vocab size in config doc * Add tokenizer files from MBart50 * Allow no lang code in regular tokenizer * Add PLBart Tokenizer Converters * Remove mask from multi tokenizer * Remove mask from multi tokenizer * Change from MBart-50 to MBart tokenizer * Fix names and modify src/tgt behavior * Fix imports for tokenizer * Remove <mask> from multi tokenizer * Fix style * Change tokenizer_class to processor_class * Add attribute map to config class * Update modeling file to modified MBart code * Update configuration file to MBart style configuration * Fix tokenizer * Separate tokenizers * Fix error in tokenization auto * Copy MBart tests * Replace with MBart tokenization tests * Fix style * Fix language code in multi tokenizer * Fix configuration docs * Add entry for plbart_multi in transformers init * Add dummy objects and fix imports * Fix modeling tests * Add TODO in config * Fix copyright year * Fix modeling docs and test * Fix some tokenization tests and style * Add changes from review * Fix copies * Fix docs * Fix docs * Fix style * Fix year * Add changes from review * Remove extra changes * Fix base tokenizer and doc * Fix style * Fix modeling and slow tokenizer tests * Remove Multi-tokenizer Converter and Tests * Delete QA model and Multi Tokenizer dummy objects * Fix repo consistency and code quality issues * Fix example documentation * Fix style * Remove PLBartTokenizer from type checking in init * Fix consistency issue * Add changes from review * Fix style * Remove PLBartTokenizerFast * Remove FastTokenizer converter * Fix AutoTokenzier mapping * Add plbart to toctree and fix consistency issues * Add language codes tokenizer test * Fix styling and doc issues * Add fixes for failing tests * Fix copies * Fix failing modeling test * Change assert to assertTrue in modeling tests |
||
|---|---|---|
| .. | ||
| internal | ||
| main_classes | ||
| model_doc | ||
| _config.py | ||
| _toctree.yml | ||
| accelerate.mdx | ||
| add_new_model.mdx | ||
| add_new_pipeline.mdx | ||
| autoclass_tutorial.mdx | ||
| benchmarks.mdx | ||
| bertology.mdx | ||
| community.mdx | ||
| contributing.md | ||
| converting_tensorflow_models.mdx | ||
| create_a_model.mdx | ||
| custom_datasets.mdx | ||
| custom_models.mdx | ||
| debugging.mdx | ||
| examples.md | ||
| fast_tokenizers.mdx | ||
| glossary.mdx | ||
| index.mdx | ||
| installation.mdx | ||
| migration.mdx | ||
| model_sharing.mdx | ||
| model_summary.mdx | ||
| multilingual.mdx | ||
| notebooks.md | ||
| parallelism.mdx | ||
| performance.mdx | ||
| perplexity.mdx | ||
| philosophy.mdx | ||
| pipeline_tutorial.mdx | ||
| pr_checks.mdx | ||
| preprocessing.mdx | ||
| quicktour.mdx | ||
| sagemaker.mdx | ||
| serialization.mdx | ||
| task_summary.mdx | ||
| testing.mdx | ||
| tokenizer_summary.mdx | ||
| training.mdx | ||
| troubleshooting.mdx | ||