Li Dong d0d9b384f2 LayerNorm initialization ... The LayerNorm gamma and beta should be initialized by .fill_(1.0) and .zero_(). reference links: 989e78c412/tensorflow/contrib/layers/python/layers/layers.py (L2298) 989e78c412/tensorflow/contrib/layers/python/layers/layers.py (L2308)		2019-01-07 15:51:33 +08:00
..
__init__.py	include version number + comment in setup.py	2018-12-13 12:50:44 +01:00
__main__.py	Convert scripts into entry_points	2018-12-19 02:26:08 +00:00
convert_tf_checkpoint_to_pytorch.py	clean up apex integration	2018-12-13 13:02:17 +01:00
file_utils.py	set encoding to 'utf-8' in calls to open	2018-12-14 13:48:58 +01:00
modeling.py	LayerNorm initialization	2019-01-07 15:51:33 +08:00
optimization.py	change to apex for better fp16 and multi-gpu support	2018-12-11 17:13:58 -08:00
tokenization.py	Merge pull request #127 from patrick-s-h-lewis/tokenizer-error-on-long-seqs	2018-12-19 10:29:17 +01:00