riaz.somc/transformers
1
0
Fork 0
mirror of https://github.com/huggingface/transformers.git synced 2025-07-19 12:38:23 +06:00
Code Issues Actions 21 Packages Projects Releases Wiki Activity
6,636 Commits 876 Branches 227 Tags 2 GiB
26f8b2cb10
Commit Graph

3 Commits

Author SHA1 Message Date
Sylvain Gugger
26f8b2cb10
Make Barthez tokenizer tests a bit faster (#10399) 
* Make Barthez tokenizer tests a bit faster

* Quality
 2021-02-25 11:42:25 -05:00
Sylvain Gugger
9e147d31f6
Deprecate prepare_seq2seq_batch (#10287) 
* Deprecate prepare_seq2seq_batch

* Fix last tests

* Apply suggestions from code review

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>
Co-authored-by: Suraj Patil <surajp815@gmail.com>

* More review comments

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>
Co-authored-by: Suraj Patil <surajp815@gmail.com>
 2021-02-22 12:36:16 -05:00
Suraj Patil
6fc940ed09
Add mBART-50 (#10154) 
* add tokenizer for mBART-50

* update tokenizers

* make src_lang and tgt_lang optional

* update tokenizer test

* add setter

* update docs

* update conversion script

* update docs

* update conversion script

* update tokenizer

* update test

* update docs

* doc

* address Sylvain's suggestions

* fix test

* fix formatting

* nits
 2021-02-15 20:58:54 +05:30