riaz.somc/transformers
1
0
Fork 0
mirror of https://github.com/huggingface/transformers.git synced 2025-08-03 03:31:05 +06:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity
6c87b73d6b
transformers/model_cards/rdenadai/BR_BERTo
History
Rodolfo De Nadai f7f03b22dc
Update README.md of my model (#6042)
2020-07-26 23:31:49 +02:00
..
README.md Update README.md of my model (#6042) 2020-07-26 23:31:49 +02:00

README.md

language tags widget
pt
portuguese
brazil
pt_BR
text
gostei muito dessa <mask>

BR_BERTo

Portuguese (Brazil) model for text inference.

Params

Trained on a corpus of 5_258_624 sentences, with 132_807_374 non unique tokens (992_418 unique tokens).

  • Vocab size: 220_000
  • RobertaForMaskedLM size : 32
  • Num train epochs: 2
  • Time to train: ~23hs (on GCP with a Nvidia T4)

I follow the great tutorial from HuggingFace team:

How to train a new language model from scratch using Transformers and Tokenizers