mirror of
https://github.com/huggingface/transformers.git
synced 2025-07-28 16:52:24 +06:00
f98d0ef2a2
* Big cleanup of `glue_convert_examples_to_features` * Use batch_encode_plus * Cleaner wrapping of glue_convert_examples_to_features for TF @lysandrejik * Cleanup syntax, thanks to @mfuntowicz * Raise explicit error in case of user error |
||
|---|---|---|
| .. | ||
| README.md | ||
| run_pl_glue.py | ||
| run_pl.sh | ||
GLUE Benchmark
Based on the script run_glue.py.
Run PyTorch version using PyTorch-Lightning
Run bash run_pl.sh from the glue directory. This will also install pytorch-lightning and the requirements in examples/requirements.txt. It is a shell pipeline that will automatically download, pre-process the data and run the specified models. Logs are saved in lightning_logs directory.
Pass --n_gpu flag to change the number of GPUs. Default uses 1. At the end, the expected results are: TEST RESULTS {'val_loss': tensor(0.0707), 'precision': 0.852427800698191, 'recall': 0.869537067011978, 'f1': 0.8608974358974358}