transformers/model_cards/jannesg/takalane_xho_roberta

language	thumbnail	tags	license
xho	https://pbs.twimg.com/media/EVjR6BsWoAAFaq5.jpg	xho fill-mask pytorch roberta lm-head masked-lm	MIT

Takalani Sesame - Xhosa 🇿🇦

Model description

Takalani Sesame (named after the South African version of Sesame Street) is a project that aims to promote the use of South African languages in NLP, and in particular look at techniques for low-resource languages to equalise performance with larger languages around the world.

Intended uses & limitations

How to use

from transformers import AutoTokenizer, AutoModelWithLMHead

tokenizer = AutoTokenizer.from_pretrained("jannesg/takalane_xho_roberta")

model = AutoModelWithLMHead.from_pretrained("jannesg/takalane_xho_roberta")

Limitations and bias

Updates will be added continously to improve performance.

Training data

Data collected from https://wortschatz.uni-leipzig.de/en
Sentences: 100000

Training procedure

No preprocessing. Standard Huggingface hyperparameters.

Author

Jannes Germishuys website