transformers/tests/marian
Suraj Patil ba21001f4c
support new marian models (#15831)
* support not sharing embeddings

* update modeling

* update tokenizer

* fix conversion script

* always use self.shared

* boom boom

* begin tests

* update tests

* fix resize_decoder_token_embeddings

* address Patrick's comments

* style

* update conversion script

* fix conversion script

* fix tokenizer

* better name target vocab

* add integration test for tokenizer with two vocabs

* style

* address Patrick's comments

* add integration test for model
2022-03-10 19:41:56 +01:00
..
__init__.py [Test refactor 1/5] Per-folder tests reorganization (#15725) 2022-02-23 15:46:28 -05:00
test_modeling_flax_marian.py [Test refactor 1/5] Per-folder tests reorganization (#15725) 2022-02-23 15:46:28 -05:00
test_modeling_marian.py support new marian models (#15831) 2022-03-10 19:41:56 +01:00
test_modeling_tf_marian.py TF generate refactor - past without encoder outputs (#15944) 2022-03-08 14:46:44 +00:00
test_tokenization_marian.py support new marian models (#15831) 2022-03-10 19:41:56 +01:00