Pi Esposito fb2b45e562 add in layer gpt2 tokenizer (#20421) ... * add minimal working gpt2 tokenizer * graph mode and output equivalence tests working * not today tensorflow. serialization test passing! * fix style, documentation, docstrings and all that jazz * passing consistency checks * move keras nlp to tf dependencies * fix tf modeling utils and gpt2 attention to enable compiling * fix (I hope) keras nlp dependencies * rever changes on generation * remove debug prints * remove redundant tf dummy objects * add from config, get config and max length settings to address review * let flake ignore the error on distillation you are welcome * test from config * add padding test * address sgugger review		2022-11-29 10:02:40 -05:00
..
__init__.py	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
test_modeling_flax_gpt2.py	Generate: move generation_*.py src files into generation/*.py (#20096)	2022-11-09 15:34:08 +00:00
test_modeling_gpt2.py	Generate: move generation_*.py src files into generation/*.py (#20096)	2022-11-09 15:34:08 +00:00
test_modeling_tf_gpt2.py	Generate: TF contrastive search with XLA support (#20050)	2022-11-07 10:54:29 +00:00
test_tokenization_gpt2_tf.py	add in layer gpt2 tokenizer (#20421)	2022-11-29 10:02:40 -05:00
test_tokenization_gpt2.py	Fixing OPT fast tokenizer option. (#18753)	2022-09-15 17:12:58 +02:00