7 Commits

Author	SHA1	Message	Date
Nicholas Vadivelu	1ab147d648	Remove redundant nn.log_softmax in run_flax_glue.py (#11920) ... * Remove redundant `nn.log_softmax` in `run_flax_glue.py` `optax.softmax_cross_entropy` expects unnormalized logits, and so it already calls `nn.log_softmax`, so I believe it is not needed here. `nn.log_softmax` is idempotent so mathematically it shouldn't have made a difference. * Remove unused 'flax.linen' import	2021-05-31 15:29:04 +01:00
Patrick von Platen	82335185fe	[Flax] Small fixes in run_flax_glue.py (#11820) ... * fix_torch_device_generate_test * remove @ * correct best seed for flax fine-tuning Co-authored-by: Patrick von Platen <patrick@huggingface.co>	2021-05-21 16:52:23 +01:00
Patrick von Platen	bd9871657b	[Flax] Align GLUE training script with mlm training script (#11778) ... * speed up flax glue * remove unnecessary line * remove folder * remove run in loop Co-authored-by: Patrick von Platen <patrick@huggingface.co>	2021-05-21 09:36:56 +01:00
Marc van Zee	726e953d44	Improvements to Flax finetuning script (#11727) ... * Add Cloud details to README * Flax script and readme updates * Some simplifications of Flax script	2021-05-17 09:26:33 +01:00
Patrick von Platen	113eaa7575	correct example script (#11726)	2021-05-14 12:02:57 +01:00
Marc van Zee	6797cdc077	Updates README and fixes bug (#11701)	2021-05-12 13:52:52 +01:00
Marc van Zee	4ce6bcc310	Adds Flax BERT finetuning example on GLUE (#11564) ... * Adds Flax BERT finetuning example * fix traced jax tensor type * Use Optax losses and learning schedulers * Add 1GPU training results * merge into master & make style * fix input * del file * Fix bug in loss and add torch runs * finish bert flax fine-tune * Update examples/flax/text-classification/README.md * Update examples/flax/text-classification/run_flax_glue.py * add requirements * finalize * finalize Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com> Co-authored-by: Patrick von Platen <patrick@huggingface.co>	2021-05-11 19:02:59 +01:00