riaz.somc/transformers
1
0
Fork 0
mirror of https://github.com/huggingface/transformers.git synced 2025-07-31 02:02:21 +06:00
Code Issues Actions 33 Packages Projects Releases Wiki Activity
7b8bdd8601
transformers/templates/adding_a_new_model/cookiecutter-template-{{cookiecutter.modelname}}
History
SaulLu 7b8bdd8601
fix the tokenizer_config.json file for the slow tokenizer when a fast version is available (#15319) 
* add new test

* update test

* remove `tokenizer_file` from `additional_files_names` in `tokenization_utils_base.py`

* add `tokenizer_file` for the fast only tokenizer

* change global variables layoutxml

* remove `"tokenizer_file"` from DPR tokenizer's Global variables

* remove `tokenizer_file` from herbert slow tokenizer init

* `"tokenizer_file"` from LED tokenizer's Global variables

* remove `tokenizer_file` from mbart slow tokenizer init

* remove `tokenizer_file` from slow tokenizer template

* adapt to versioning

* adapt the `test_tokenizer_mismatch_warning` test

* clean test

* clarify `VOCAB_FILES_NAMES` in tokenization_utils_fast.py

* Revert "remove `tokenizer_file` from mbart slow tokenizer init"

This reverts commit 0dbb723fa9.

* Revert "`"tokenizer_file"` from LED tokenizer's Global variables"

This reverts commit 5a3f879bdd.

* Revert "remove `tokenizer_file` from herbert slow tokenizer init"

This reverts commit f5e10007b7.

* Revert "remove `"tokenizer_file"` from DPR tokenizer's Global variables"

This reverts commit da0895330b.

* set `tokenizer_file` in super `__init__` of mbart
2022-02-01 16:48:25 +01:00
..
__init__.py Adds missing module_specs for usages of _LazyModule (#15230) 2022-01-21 07:30:12 -05:00
{{cookiecutter.lowercase_modelname}}.mdx Check the repo consistency in model templates test (#15141) 2022-01-14 04:52:38 -05:00
configuration_{{cookiecutter.lowercase_modelname}}.py Happy New Year! (#15094) 2022-01-10 12:05:57 -05:00
configuration.json Add template for adding flax models (#12441) 2021-09-01 09:49:03 +02:00
modeling_{{cookiecutter.lowercase_modelname}}.py Fix loss calculation in TFXXXForTokenClassification models (#15294) 2022-01-31 11:43:08 -05:00
modeling_flax_{{cookiecutter.lowercase_modelname}}.py [Fix doc example] fix missing import jnp (#15291) 2022-01-24 14:54:23 +01:00
modeling_tf_{{cookiecutter.lowercase_modelname}}.py Fix TF Causal LM models' returned logits (#15256) 2022-02-01 11:04:07 +00:00
test_modeling_{{cookiecutter.lowercase_modelname}}.py Happy New Year! (#15094) 2022-01-10 12:05:57 -05:00
test_modeling_flax_{{cookiecutter.lowercase_modelname}}.py Happy New Year! (#15094) 2022-01-10 12:05:57 -05:00
test_modeling_tf_{{cookiecutter.lowercase_modelname}}.py Happy New Year! (#15094) 2022-01-10 12:05:57 -05:00
to_replace_{{cookiecutter.lowercase_modelname}}.py Happy New Year! (#15094) 2022-01-10 12:05:57 -05:00
tokenization_{{cookiecutter.lowercase_modelname}}.py fix the tokenizer_config.json file for the slow tokenizer when a fast version is available (#15319) 2022-02-01 16:48:25 +01:00
tokenization_fast_{{cookiecutter.lowercase_modelname}}.py Happy New Year! (#15094) 2022-01-10 12:05:57 -05:00