Tokenizer
----------------------------------------------------

``PreTrainedTokenizer``
~~~~~~~~~~~~~~~~~~~~~~~~

.. autoclass:: pytorch_transformers.PreTrainedTokenizer
    :members: