Commit Graph

3 Commits

Author SHA1 Message Date
LysandreJik
72402d1acd Fixed DistilBERT tokenizer 2019-09-24 09:41:14 -04:00
LysandreJik
bf503158c5 Sentence -> Sequence. Removed output_mask from the special token addition methods. 2019-09-19 10:55:06 +02:00
LysandreJik
c4d4f3ec8c Updated DistilBERT test to reflect the sequence encoding 2019-09-19 10:55:06 +02:00