Minor fix.

This commit is contained in:
Daniel Khashabi 2018-12-14 14:10:36 -05:00 committed by GitHub
parent 8809eb6c93
commit 8b1b93947f
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23

View File

@ -517,8 +517,7 @@ python ./run_squad.py \
--doc_stride 128 \
--output_dir $OUTPUT_DIR \
--train_batch_size 24 \
--gradient_accumulation_steps 2 \
--optimize_on_cpu
--gradient_accumulation_steps 2
```
If you have a recent GPU (starting from NVIDIA Volta series), you should try **16-bit fine-tuning** (FP16).