thomwolf e8fe6b7140 adapting transfo tokenizer to transposed inputs		2019-02-11 13:30:04 +01:00
..
__init__.py	adding file cache to __init__	2019-02-08 22:31:46 +01:00
__main__.py	updating __main__	2019-02-08 22:31:57 +01:00
convert_openai_checkpoint_to_pytorch.py	python 2 compatibility	2019-02-06 00:07:46 +01:00
convert_tf_checkpoint_to_pytorch.py	splitting position and tokens embeddings in OpenAI GPT - updating tf imports - tests	2019-01-29 10:31:42 +01:00
convert_transfo_xl_checkpoint_to_pytorch.py	add two transformer xl models	2019-02-07 17:07:03 +01:00
file_utils.py	fix python 2.7 imports	2019-02-11 10:35:36 +01:00
modeling_openai.py	mc_token_mask => mc_token_ids	2019-02-09 16:58:53 +01:00
modeling_transfo_xl_utilities.py	update transfo xl example	2019-02-09 16:59:17 +01:00
modeling_transfo_xl.py	transposing the inputs of Transformer-XL to have a unified interface	2019-02-11 13:19:59 +01:00
modeling.py	adding option to load on cpu	2019-02-08 10:37:40 +01:00
optimization_openai.py	add OpenAI GPT	2019-01-08 12:26:58 +01:00
optimization.py	change to apex for better fp16 and multi-gpu support	2018-12-11 17:13:58 -08:00
tokenization_openai.py	added tests for OpenAI GPT and Transformer-XL tokenizers	2019-02-11 10:17:16 +01:00
tokenization_transfo_xl.py	adapting transfo tokenizer to transposed inputs	2019-02-11 13:30:04 +01:00
tokenization.py	more explicit variable name	2019-02-08 09:54:49 +01:00