6 Commits

Author	SHA1	Message	Date
lukovnikov	e04bab59e1	fix for negative learning rate with warmup_linear in BertAdam (happens when t_total is specified incorrectly) ... + copied BERT optimization warmup functions to OpenAI optimization file + added comments	2019-02-26 16:22:52 +01:00
Deyu Fu	c8ea286048	change to apex for better fp16 and multi-gpu support	2018-12-11 17:13:58 -08:00
Li Li	81e1e2489f	Fix optimizer to work with horovod	2018-12-10 02:08:38 -08:00
thomwolf	757750d6f6	fix tests	2018-11-17 11:58:14 +01:00
thomwolf	886cb49792	updating readme and notebooks	2018-11-16 14:31:15 +01:00
thomwolf	1de35b624b	preparing for first release	2018-11-15 20:56:10 +01:00