riaz.somc/transformers
1
0
Fork 0
mirror of https://github.com/huggingface/transformers.git synced 2025-07-31 02:02:21 +06:00
Code Issues Actions 23 Packages Projects Releases Wiki Activity
9b7fb8a368
transformers/model_cards/distilbert-base-cased-distilled-squad-README.md
Victor SANH 969ccac2e9
adding model cards for distilled models (#8300) 
* adding model cards for distil models

* forgot the languages
2020-11-04 11:41:45 -05:00

433 B
Raw Blame History

language datasets metrics license
en
squad
squad
apache-2.0

DistilBERT base cased distilled SQuAD

This model is a fine-tune checkpoint of DistilBERT-base-cased, fine-tuned using (a second step of) knowledge distillation on SQuAD v1.1. This model reaches a F1 score of 87.1 on the dev set (for comparison, BERT bert-base-cased version reaches a F1 score of 88.7).