thomwolf 01a3966bc6 more options on special tokens		2019-02-04 17:26:25 +01:00
..
__init__.py	update __init__	2019-01-29 09:54:08 +01:00
__main__.py	splitting position and tokens embeddings in OpenAI GPT - updating tf imports - tests	2019-01-29 10:31:42 +01:00
convert_openai_checkpoint_to_pytorch.py	splitting position and tokens embeddings in OpenAI GPT - updating tf imports - tests	2019-01-29 10:31:42 +01:00
convert_tf_checkpoint_to_pytorch.py	splitting position and tokens embeddings in OpenAI GPT - updating tf imports - tests	2019-01-29 10:31:42 +01:00
convert_transfo_xl_checkpoint_to_pytorch.py	updating code organization to fix imports	2019-01-28 17:03:39 +01:00
file_utils.py	set encoding to 'utf-8' in calls to open	2018-12-14 13:48:58 +01:00
modeling_openai.py	update config, docstrings and readme to switch to seperated tokens and position embeddings	2019-01-29 11:00:11 +01:00
modeling_transfo_xl_utilities.py	updating code organization to fix imports	2019-01-28 17:03:39 +01:00
modeling_transfo_xl.py	splitting position and tokens embeddings in OpenAI GPT - updating tf imports - tests	2019-01-29 10:31:42 +01:00
modeling.py	splitting position and tokens embeddings in OpenAI GPT - updating tf imports - tests	2019-01-29 10:31:42 +01:00
optimization_openai.py	add OpenAI GPT	2019-01-08 12:26:58 +01:00
optimization.py	change to apex for better fp16 and multi-gpu support	2018-12-11 17:13:58 -08:00
tokenization_openai.py	more options on special tokens	2019-02-04 17:26:25 +01:00
tokenization_transfo_xl.py	fixing various parts of model conversion, loading and weights sharing	2019-01-16 10:31:16 +01:00
tokenization.py	Merge pull request #127 from patrick-s-h-lewis/tokenizer-error-on-long-seqs	2018-12-19 10:29:17 +01:00