2 Commits

Author	SHA1	Message	Date
TFUsers	00112c3539	Replace swish with silu (#8166) ... * Replace swish with silu * revert nn.silu to nn.swish due to older version * simplify optimized silu conditional and fix format * Update activations.py * Update activations_tf.py * Update modeling_flax_utils.py * Update modeling_openai.py * add swish testcase * add pytorch swish testcase * Add more robust python version check * more formatting fixes Co-authored-by: TFUsers <TFUsers@gmail.com>	2020-10-30 15:09:10 -04:00
Julien Plu	af8425b749	Refactoring the TF activations functions (#7150) ... * Refactoring the activations functions into a common file * Apply style * remove unused import * fix tests * Fix tests.	2020-09-16 07:03:47 -04:00