Matt ee0d001de7 Add a TF in-graph tokenizer for BERT (#17701) ... * Add a TF in-graph tokenizer for BERT * Add from_pretrained * Add proper truncation, option handling to match other tokenizers * Add proper imports and guards * Add test, fix all the bugs exposed by said test * Fix truncation of paired texts in graph mode, more test updates * Small fixes, add a (very careful) test for savedmodel * Add tensorflow-text dependency, make fixup * Update documentation * Update documentation * make fixup * Slight changes to tests * Add some docstring examples * Update tests * Update tests and add proper lowercasing/normalization * make fixup * Add docstring for padding! * Mark slow tests * make fixup * Fall back to BertTokenizerFast if BertTokenizer is unavailable * Fall back to BertTokenizerFast if BertTokenizer is unavailable * make fixup * Properly handle tensorflow-text dummies		2022-06-27 12:06:21 +01:00
..
en	Add a TF in-graph tokenizer for BERT (#17701)	2022-06-27 12:06:21 +01:00
es	Fix gendered sentence in Spanish translation(#17558)	2022-06-07 14:09:39 +02:00
it	Translation/autoclass (#17615)	2022-06-09 20:56:44 -04:00
pt	Added translation of index.mdx to Portuguese Issue #16824 (#17565)	2022-06-17 20:06:05 -04:00
_config.py	Use doc builder styler (#16412)	2022-03-28 07:45:18 -04:00