transformers/templates
Patrick von Platen 538b3b4607
[Tokenizer Utils Base] Make pad function more flexible (#9928)
* change tokenizer requirement

* split line

* Correct typo from list to str

* improve style

* make other function pretty as well

* add comment

* correct typo

* add new test

* pass tests for tok without padding token

* Apply suggestions from code review
2021-02-02 10:35:27 +03:00
..
adding_a_new_example_script Deprecate model_path in Trainer.train (#9854) 2021-01-28 08:32:46 -05:00
adding_a_new_model [Tokenizer Utils Base] Make pad function more flexible (#9928) 2021-02-02 10:35:27 +03:00