riaz.somc/transformers
1
0
Fork 0
mirror of https://github.com/huggingface/transformers.git synced 2025-07-30 17:52:35 +06:00
Code Issues Actions 30 Packages Projects Releases Wiki Activity
9208f57b16
transformers/model_cards/DeepPavlov/bert-base-bg-cs-pl-ru-cased
History
Aleksei Lymar 73a0c25376 remove excess line breaks in DeepPavlov model cards
2020-03-06 17:19:35 -05:00
..
README.md remove excess line breaks in DeepPavlov model cards 2020-03-06 17:19:35 -05:00

README.md

language
bulgarian
czech
polish
russian

bert-base-bg-cs-pl-ru-cased

SlavicBERT[1] Slavic \(bg, cs, pl, ru, cased, 12‑layer, 768‑hidden, 12‑heads, 180M parameters) was trained on Russian News and four Wikipedias: Bulgarian, Czech, Polish, and Russian. Subtoken vocabulary was built using this data. Multilingual BERT was used as an initialization for SlavicBERT.

1