mirror of
https://github.com/huggingface/transformers.git
synced 2025-07-03 12:50:06 +06:00
eedd21b9e7
* Fixed typo: insted to instead * Fixed typo: relase to release * Fixed typo: nighlty to nightly * Fixed typos: versatible, benchamarks, becnhmark to versatile, benchmark, benchmarks * Fixed typo in comment: quantizd to quantized * Fixed typo: architecutre to architecture * Fixed typo: contibution to contribution * Fixed typo: Presequities to Prerequisites * Fixed typo: faste to faster * Fixed typo: extendeding to extending * Fixed typo: segmetantion_maps to segmentation_maps * Fixed typo: Alternativelly to Alternatively * Fixed incorrectly defined variable: output to output_disabled * Fixed typo in library name: tranformers.onnx to transformers.onnx * Fixed missing import: import tensorflow as tf * Fixed incorrectly defined variable: token_tensor to tokens_tensor * Fixed missing import: import torch * Fixed incorrectly defined variable and typo: uromaize to uromanize * Fixed incorrectly defined variable and typo: uromaize to uromanize * Fixed typo in function args: numpy.ndarry to numpy.ndarray * Fixed Inconsistent Library Name: Torchscript to TorchScript * Fixed Inconsistent Class Name: OneformerProcessor to OneFormerProcessor * Fixed Inconsistent Class Named Typo: TFLNetForMultipleChoice to TFXLNetForMultipleChoice * Fixed Inconsistent Library Name Typo: Pytorch to PyTorch * Fixed Inconsistent Function Name Typo: captureWarning to captureWarnings * Fixed Inconsistent Library Name Typo: Pytorch to PyTorch * Fixed Inconsistent Class Name Typo: TrainingArgument to TrainingArguments * Fixed Inconsistent Model Name Typo: Swin2R to Swin2SR * Fixed Inconsistent Model Name Typo: EART to BERT * Fixed Inconsistent Library Name Typo: TensorFLow to TensorFlow * Fixed Broken Link for Speech Emotion Classification with Wav2Vec2 * Fixed minor missing word Typo * Fixed minor missing word Typo * Fixed minor missing word Typo * Fixed minor missing word Typo * Fixed minor missing word Typo * Fixed minor missing word Typo * Fixed minor missing word Typo * Fixed minor missing word Typo * Fixed Punctuation: Two commas * Fixed Punctuation: No Space between XLM-R and is * Fixed Punctuation: No Space between [~accelerate.Accelerator.backward] and method * Added backticks to display model.fit() in codeblock * Added backticks to display openai-community/gpt2 in codeblock * Fixed Minor Typo: will to with * Fixed Minor Typo: is to are * Fixed Minor Typo: in to on * Fixed Minor Typo: inhibits to exhibits * Fixed Minor Typo: they need to it needs * Fixed Minor Typo: cast the load the checkpoints To load the checkpoints * Fixed Inconsistent Class Name Typo: TFCamembertForCasualLM to TFCamembertForCausalLM * Fixed typo in attribute name: outputs.last_hidden_states to outputs.last_hidden_state * Added missing verbosity level: fatal * Fixed Minor Typo: take To takes * Fixed Minor Typo: heuristic To heuristics * Fixed Minor Typo: setting To settings * Fixed Minor Typo: Content To Contents * Fixed Minor Typo: millions To million * Fixed Minor Typo: difference To differences * Fixed Minor Typo: while extract To which extracts * Fixed Minor Typo: Hereby To Here * Fixed Minor Typo: addition To additional * Fixed Minor Typo: supports To supported * Fixed Minor Typo: so that benchmark results TO as a consequence, benchmark * Fixed Minor Typo: a To an * Fixed Minor Typo: a To an * Fixed Minor Typo: Chain-of-though To Chain-of-thought
7.4 KiB
7.4 KiB
Padding and truncation
Batched inputs are often different lengths, so they can't be converted to fixed-size tensors. Padding and truncation are strategies for dealing with this problem, to create rectangular tensors from batches of varying lengths. Padding adds a special padding token to ensure shorter sequences will have the same length as either the longest sequence in a batch or the maximum length accepted by the model. Truncation works in the other direction by truncating long sequences.
In most cases, padding your batch to the length of the longest sequence and truncating to the maximum length a model can accept works pretty well. However, the API supports more strategies if you need them. The three arguments you need to know are: padding, truncation and max_length.
The padding argument controls padding. It can be a boolean or a string:
Trueor'longest': pad to the longest sequence in the batch (no padding is applied if you only provide a single sequence).'max_length': pad to a length specified by themax_lengthargument or the maximum length accepted by the model if nomax_lengthis provided (max_length=None). Padding will still be applied if you only provide a single sequence.Falseor'do_not_pad': no padding is applied. This is the default behavior.
The truncation argument controls truncation. It can be a boolean or a string:
Trueor'longest_first': truncate to a maximum length specified by themax_lengthargument or the maximum length accepted by the model if nomax_lengthis provided (max_length=None). This will truncate token by token, removing a token from the longest sequence in the pair until the proper length is reached.'only_second': truncate to a maximum length specified by themax_lengthargument or the maximum length accepted by the model if nomax_lengthis provided (max_length=None). This will only truncate the second sentence of a pair if a pair of sequences (or a batch of pairs of sequences) is provided.'only_first': truncate to a maximum length specified by themax_lengthargument or the maximum length accepted by the model if nomax_lengthis provided (max_length=None). This will only truncate the first sentence of a pair if a pair of sequences (or a batch of pairs of sequences) is provided.Falseor'do_not_truncate': no truncation is applied. This is the default behavior.
The max_length argument controls the length of the padding and truncation. It can be an integer or None, in which case it will default to the maximum length the model can accept. If the model has no specific maximum input length, truncation or padding to max_length is deactivated.
The following table summarizes the recommended way to setup padding and truncation. If you use pairs of input sequences in any of the following examples, you can replace truncation=True by a STRATEGY selected in
['only_first', 'only_second', 'longest_first'], i.e. truncation='only_second' or truncation='longest_first' to control how both sequences in the pair are truncated as detailed before.
| Truncation | Padding | Instruction |
|---|---|---|
| no truncation | no padding | tokenizer(batch_sentences) |
| padding to max sequence in batch | tokenizer(batch_sentences, padding=True) or |
|
tokenizer(batch_sentences, padding='longest') |
||
| padding to max model input length | tokenizer(batch_sentences, padding='max_length') |
|
| padding to specific length | tokenizer(batch_sentences, padding='max_length', max_length=42) |
|
| padding to a multiple of a value | tokenizer(batch_sentences, padding=True, pad_to_multiple_of=8) |
|
| truncation to max model input length | no padding | tokenizer(batch_sentences, truncation=True) or |
tokenizer(batch_sentences, truncation=STRATEGY) |
||
| padding to max sequence in batch | tokenizer(batch_sentences, padding=True, truncation=True) or |
|
tokenizer(batch_sentences, padding=True, truncation=STRATEGY) |
||
| padding to max model input length | tokenizer(batch_sentences, padding='max_length', truncation=True) or |
|
tokenizer(batch_sentences, padding='max_length', truncation=STRATEGY) |
||
| padding to specific length | Not possible | |
| truncation to specific length | no padding | tokenizer(batch_sentences, truncation=True, max_length=42) or |
tokenizer(batch_sentences, truncation=STRATEGY, max_length=42) |
||
| padding to max sequence in batch | tokenizer(batch_sentences, padding=True, truncation=True, max_length=42) or |
|
tokenizer(batch_sentences, padding=True, truncation=STRATEGY, max_length=42) |
||
| padding to max model input length | Not possible | |
| padding to specific length | tokenizer(batch_sentences, padding='max_length', truncation=True, max_length=42) or |
|
tokenizer(batch_sentences, padding='max_length', truncation=STRATEGY, max_length=42) |