mirror of
https://github.com/huggingface/transformers.git
synced 2025-07-04 21:30:07 +06:00
3323146e90
* Clean up model documentation * Formatting * Preparation work * Long lines * Main work on rst files * Cleanup all config files * Syntax fix * Clean all tokenizers * Work on first models * Models beginning * FaluBERT * All PyTorch models * All models * Long lines again * Fixes * More fixes * Update docs/source/model_doc/bert.rst Co-authored-by: Lysandre Debut <lysandre@huggingface.co> * Update docs/source/model_doc/electra.rst Co-authored-by: Lysandre Debut <lysandre@huggingface.co> * Last fixes Co-authored-by: Lysandre Debut <lysandre@huggingface.co>
88 lines
2.9 KiB
ReStructuredText
88 lines
2.9 KiB
ReStructuredText
Custom Layers and Utilities
|
|
-----------------------------------------------------------------------------------------------------------------------
|
|
|
|
This page lists all the custom layers used by the library, as well as the utility functions it provides for modeling.
|
|
|
|
Most of those are only useful if you are studying the code of the models in the library.
|
|
|
|
|
|
Pytorch custom modules
|
|
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
|
|
|
|
.. autoclass:: transformers.modeling_utils.Conv1D
|
|
|
|
.. autoclass:: transformers.modeling_utils.PoolerStartLogits
|
|
:members: forward
|
|
|
|
.. autoclass:: transformers.modeling_utils.PoolerEndLogits
|
|
:members: forward
|
|
|
|
.. autoclass:: transformers.modeling_utils.PoolerAnswerClass
|
|
:members: forward
|
|
|
|
.. autoclass:: transformers.modeling_utils.SquadHeadOutput
|
|
|
|
.. autoclass:: transformers.modeling_utils.SQuADHead
|
|
:members: forward
|
|
|
|
.. autoclass:: transformers.modeling_utils.SequenceSummary
|
|
:members: forward
|
|
|
|
|
|
PyTorch Helper Functions
|
|
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
|
|
|
|
.. autofunction:: transformers.apply_chunking_to_forward
|
|
|
|
.. autofunction:: transformers.modeling_utils.find_pruneable_heads_and_indices
|
|
|
|
.. autofunction:: transformers.modeling_utils.prune_layer
|
|
|
|
.. autofunction:: transformers.modeling_utils.prune_conv1d_layer
|
|
|
|
.. autofunction:: transformers.modeling_utils.prune_linear_layer
|
|
|
|
TensorFlow custom layers
|
|
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
|
|
|
|
.. autoclass:: transformers.modeling_tf_utils.TFConv1D
|
|
|
|
.. autoclass:: transformers.modeling_tf_utils.TFSharedEmbeddings
|
|
:members: call
|
|
|
|
.. autoclass:: transformers.modeling_tf_utils.TFSequenceSummary
|
|
:members: call
|
|
|
|
|
|
TensorFlow loss functions
|
|
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
|
|
|
|
.. autoclass:: transformers.modeling_tf_utils.TFCausalLanguageModelingLoss
|
|
:members:
|
|
|
|
.. autoclass:: transformers.modeling_tf_utils.TFMaskedLanguageModelingLoss
|
|
:members:
|
|
|
|
.. autoclass:: transformers.modeling_tf_utils.TFMultipleChoiceLoss
|
|
:members:
|
|
|
|
.. autoclass:: transformers.modeling_tf_utils.TFQuestionAnsweringLoss
|
|
:members:
|
|
|
|
.. autoclass:: transformers.modeling_tf_utils.TFSequenceClassificationLoss
|
|
:members:
|
|
|
|
.. autoclass:: transformers.modeling_tf_utils.TFTokenClassificationLoss
|
|
:members:
|
|
|
|
|
|
TensorFlow Helper Functions
|
|
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
|
|
|
|
.. autofunction:: transformers.modeling_tf_utils.cast_bool_to_primitive
|
|
|
|
.. autofunction:: transformers.modeling_tf_utils.get_initializer
|
|
|
|
.. autofunction:: transformers.modeling_tf_utils.keras_serializable
|
|
|
|
.. autofunction:: transformers.modeling_tf_utils.shape_list |