Sylvain Gugger
|
a573777901
|
Update repo to isort v5 (#6686)
* Run new isort
* More changes
* Update CI, CONTRIBUTING and benchmarks
|
2020-08-24 11:03:01 -04:00 |
|
Sam Shleifer
|
ab42d74850
|
Fix bart base test (#6587)
|
2020-08-18 21:28:10 -04:00 |
|
Sam Shleifer
|
12d7624199
|
[marian] converter supports models from new Tatoeba project (#6342)
|
2020-08-17 23:55:42 -04:00 |
|
Sam Shleifer
|
be1520d3a3
|
rename prepare_translation_batch -> prepare_seq2seq_batch (#6103)
|
2020-08-11 15:57:07 -04:00 |
|
Sam Shleifer
|
13deb95a40
|
Move tests/utils.py -> transformers/testing_utils.py (#5350)
|
2020-07-01 10:31:17 -04:00 |
|
Sam Shleifer
|
c58e6c129a
|
[marian tests ] pass device to pipeline (#4815)
|
2020-06-06 00:52:17 -04:00 |
|
Sam Shleifer
|
4ab7424597
|
[cleanup/marian] pipelines test and new kwarg (#4812)
|
2020-06-05 18:45:19 -04:00 |
|
Sam Shleifer
|
efbc1c5a9d
|
[MarianTokenizer] implement save_vocabulary and other common methods (#4389)
|
2020-05-19 19:45:49 -04:00 |
|
Sam Shleifer
|
9a687ebb77
|
[Marian Fixes] prevent predicting pad_token_id before softmax, support language codes, name multilingual models (#4290)
|
2020-05-13 17:29:41 -04:00 |
|
Sam Shleifer
|
3487be75ef
|
[Marian] documentation and AutoModel support (#4152)
- MarianSentencepieceTokenizer - > MarianTokenizer
- Start using unk token.
- add docs page
- add better generation params to MarianConfig
- more conversion utilities
|
2020-05-10 13:54:57 -04:00 |
|
Sam Shleifer
|
847e7f3379
|
MarianMTModel.from_pretrained('Helsinki-NLP/opus-marian-en-de') (#3908)
Co-Authored-By: Stefan Schweter <stefan@schweter.it>
|
2020-04-28 18:22:37 -04:00 |
|