Suraj Patil
|
6fc940ed09
|
Add mBART-50 (#10154)
* add tokenizer for mBART-50
* update tokenizers
* make src_lang and tgt_lang optional
* update tokenizer test
* add setter
* update docs
* update conversion script
* update docs
* update conversion script
* update tokenizer
* update test
* update docs
* doc
* address Sylvain's suggestions
* fix test
* fix formatting
* nits
|
2021-02-15 20:58:54 +05:30 |
|