Yiqing-Zhou 897d0841be read().splitlines() -> readlines() ... splitlines() does not work as what we expect here for bert-base-chinese because there is a '\u2028' (unicode line seperator) token in vocab file. Value of '\u2028'.splitlines() is ['', '']. Perhaps we should use readlines() instead.		2019-07-22 20:49:09 +08:00
..
tests	update readme and pretrained model weight files	2019-07-16 15:11:29 +02:00
__init__.py	release version 1.0	2019-07-16 16:10:58 +02:00
__main__.py	update conversion scripts and __main__	2019-07-16 09:41:55 +02:00
convert_gpt2_checkpoint_to_pytorch.py	update conversion scripts and __main__	2019-07-16 09:41:55 +02:00
convert_openai_checkpoint_to_pytorch.py	update conversion scripts and __main__	2019-07-16 09:41:55 +02:00
convert_pytorch_checkpoint_to_tf.py	Merge branch 'xlnet'	2019-07-16 11:51:13 +02:00
convert_tf_checkpoint_to_pytorch.py	update conversion scripts and __main__	2019-07-16 09:41:55 +02:00
convert_transfo_xl_checkpoint_to_pytorch.py	update conversion scripts and __main__	2019-07-16 09:41:55 +02:00
convert_xlm_checkpoint_to_pytorch.py	update conversion scripts and __main__	2019-07-16 09:41:55 +02:00
convert_xlnet_checkpoint_to_pytorch.py	update conversion scripts and __main__	2019-07-16 09:41:55 +02:00
file_utils.py	import sys twice	2019-07-17 18:12:01 +09:00
modeling_bert.py	adding missing docstring fix #793	2019-07-16 21:35:53 +02:00
modeling_gpt2.py	fix docstrings	2019-07-16 15:31:21 +02:00
modeling_openai.py	fix docstrings	2019-07-16 15:31:21 +02:00
modeling_transfo_xl_utilities.py	updating examples	2019-07-11 12:03:08 +02:00
modeling_transfo_xl.py	fix docstrings	2019-07-16 15:31:21 +02:00
modeling_utils.py	model in evaluation mode by default after from_pretrained	2019-07-16 15:41:57 +02:00
modeling_xlm.py	fix docstrings	2019-07-16 15:31:21 +02:00
modeling_xlnet.py	fix docstrings	2019-07-16 15:31:21 +02:00
optimization.py	clean up optimization	2019-07-15 13:49:07 +02:00
tokenization_bert.py	read().splitlines() -> readlines()	2019-07-22 20:49:09 +08:00
tokenization_gpt2.py	update tokenizer - update squad example for xlnet	2019-07-15 17:30:42 +02:00
tokenization_openai.py	update tokenizer - update squad example for xlnet	2019-07-15 17:30:42 +02:00
tokenization_transfo_xl.py	update readme and pretrained model weight files	2019-07-16 15:11:29 +02:00
tokenization_utils.py	update readme and pretrained model weight files	2019-07-16 15:11:29 +02:00
tokenization_xlm.py	update readme and pretrained model weight files	2019-07-16 15:11:29 +02:00
tokenization_xlnet.py	update conversion scripts and __main__	2019-07-16 09:41:55 +02:00