riaz.somc/transformers
1
0
Fork 0
mirror of https://github.com/huggingface/transformers.git synced 2025-07-30 17:52:35 +06:00
Code Issues Actions 30 Packages Projects Releases Wiki Activity
9208f57b16
transformers/model_cards/DeepPavlov/rubert-base-cased
History
Aleksei Lymar 73a0c25376 remove excess line breaks in DeepPavlov model cards
2020-03-06 17:19:35 -05:00
..
README.md remove excess line breaks in DeepPavlov model cards 2020-03-06 17:19:35 -05:00

README.md

language
russian

rubert-base-cased

RuBERT Russian, cased, 12‑layer, 768‑hidden, 12‑heads, 180M parameters was trained on the Russian part of Wikipedia and news data. We used this training data to build a vocabulary of Russian subtokens and took a multilingual version of BERT‑base as an initialization for RuBERT[1].

1