riaz.somc/transformers
1
0
Fork 0
mirror of https://github.com/huggingface/transformers.git synced 2025-07-31 02:02:21 +06:00
Code Issues Actions 33 Packages Projects Releases Wiki Activity
9208f57b16
transformers/model_cards/DeepPavlov/rubert-base-cased-sentence
History
Aleksei Lymar 73a0c25376 remove excess line breaks in DeepPavlov model cards
2020-03-06 17:19:35 -05:00
..
README.md remove excess line breaks in DeepPavlov model cards 2020-03-06 17:19:35 -05:00

README.md

language
russian

rubert-base-cased-sentence

Sentence RuBERT Russian, cased, 12-layer, 768-hidden, 12-heads, 180M parameters is a representation‑based sentence encoder for Russian. It is initialized with RuBERT and fine‑tuned on SNLI[1] google-translated to russian and on russian part of XNLI dev set[2]. Sentence representations are mean pooled token embeddings in the same manner as in Sentence‑BERT[3].

1
2
3