riaz.somc/transformers
1
0
Fork 0
mirror of https://github.com/huggingface/transformers.git synced 2025-07-31 02:02:21 +06:00
Code Issues Actions 33 Packages Projects Releases Wiki Activity

[AutoTokenizer] Fix incorrect from pretrained (#14900)

Browse Source
This commit is contained in:
Patrick von Platen 2021-12-23 17:22:33 +01:00 committed by GitHub
parent 8f2cc1c3ab
commit ef47d4f848
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
src/transformers/models/auto/tokenization_auto.py
View File

@ -350,7 +350,7 @@ def get_tokenizer_config(
use_auth_token=use_auth_token,
)
except EnvironmentError:
except (EnvironmentError, ValueError):
logger.info("Could not locate the tokenizer configuration file, will try to use the model config instead.")
return {}