riaz.somc/transformers
1
0
Fork 0
mirror of https://github.com/huggingface/transformers.git synced 2025-07-13 09:40:06 +06:00
Code Issues Actions 13 Packages Projects Releases Wiki Activity
4,424 Commits 863 Branches 226 Tags 1.9 GiB
7ecff0ccbb
Commit Graph

1 Commits

Author SHA1 Message Date
Sylvain Gugger
6b735a7253
Tokenizer summary (#5467) 
* Work on tokenizer summary

* Finish tutorial

* Link to it

* Apply suggestions from code review

Co-authored-by: Anthony MOI <xn1t0x@gmail.com>
Co-authored-by: Lysandre Debut <lysandre@huggingface.co>

* Add vocab definition

Co-authored-by: Anthony MOI <xn1t0x@gmail.com>
Co-authored-by: Lysandre Debut <lysandre@huggingface.co>
 2020-07-02 17:07:42 -04:00