riaz.somc/transformers
1
0
Fork 0
mirror of https://github.com/huggingface/transformers.git synced 2025-07-31 02:02:21 +06:00
Code Issues Actions 23 Packages Projects Releases Wiki Activity

fix the warning message of overflowed sequence (#7151)

Browse Source
This commit is contained in:
Xi Ye 2020-09-16 06:40:57 -05:00 committed by GitHub
parent af8425b749
commit 08bfc1718a
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
src/transformers/tokenization_utils_base.py
View File

@ -2477,7 +2477,7 @@ class PreTrainedTokenizerBase(SpecialTokensMixin):
logger.warning(
"Token indices sequence length is longer than the specified maximum sequence length "
"for this model ({} > {}). Running this sequence through the model will result in "
"indexing errors".format(len(ids), self.model_max_length)
"indexing errors".format(len(encoded_inputs["input_ids"]), self.model_max_length)
)
# Padding