Leon Derczynski 4a419d4995 MobileBERT tokenizer tests (#16896) ... * unhardcode pretrained model path, make it a class var * add tests for mobilebert tokenizer * allow tempfiles for vocab & merge similarity test to autodelete * add explanatory comments * remove unused imports, let make style do its.. thing * remove inheritance and use BERT tok tests for MobileBERT * Update tests/mobilebert/test_tokenization_mobilebert.py Co-authored-by: SaulLu <55560583+SaulLu@users.noreply.github.com> * amend class names, remove unused import, add fix for mobilebert's hub pathname * unhardcode pretrained model path, make it a class var * add tests for mobilebert tokenizer * allow tempfiles for vocab & merge similarity test to autodelete * add explanatory comments * remove unused imports, let make style do its.. thing * remove inheritance and use BERT tok tests for MobileBERT * Update tests/mobilebert/test_tokenization_mobilebert.py Co-authored-by: SaulLu <55560583+SaulLu@users.noreply.github.com> * amend class names, remove unused import, add fix for mobilebert's hub pathname * amend paths for model tests being in models/ subdir of /tests * explicitly rm test from prev path Co-authored-by: SaulLu <55560583+SaulLu@users.noreply.github.com>		2022-05-10 16:39:58 -04:00
..
albert	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
auto	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
bart	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
barthez	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
bartpho	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
beit	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
bert	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
bert_generation	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
bert_japanese	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
bertweet	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
big_bird	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
bigbird_pegasus	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
blenderbot	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
blenderbot_small	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
bort	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
byt5	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
camembert	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
canine	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
clip	Allow saved_model export of TFCLIPModel in save_pretrained (#16886)	2022-05-04 16:37:58 +02:00
convbert	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
convnext	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
cpm	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
ctrl	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
data2vec	minor change on TF Data2Vec test (#17085)	2022-05-04 18:39:30 +02:00
deberta	Fix DeBERTa token_type_ids (#17082)	2022-05-04 18:23:37 +02:00
deberta_v2	Add DebertaV2ForMultipleChoice (#17135)	2022-05-10 16:21:44 -04:00
decision_transformer	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
deit	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
detr	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
distilbert	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
dit	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
dpr	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
dpt	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
electra	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
encoder_decoder	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
flaubert	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
fnet	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
fsmt	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
funnel	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
glpn	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
gpt_neo	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
gpt2	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
gptj	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
herbert	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
hubert	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
ibert	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
imagegpt	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
layoutlm	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
layoutlmv2	LayoutLMv2Processor: ensure 1-to-1 mapping between images and samples in case of overflowing tokens (#17092)	2022-05-09 07:39:08 -04:00
layoutxlm	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
led	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
longformer	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
luke	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
lxmert	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
m2m_100	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
marian	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
maskformer	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
mbart	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
mbart50	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
megatron_bert	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
megatron_gpt2	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
mluke	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
mobilebert	MobileBERT tokenizer tests (#16896)	2022-05-10 16:39:58 -04:00
mpnet	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
mt5	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
nystromformer	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
openai	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
pegasus	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
perceiver	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
phobert	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
plbart	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
poolformer	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
prophetnet	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
qdqbert	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
rag	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
realm	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
reformer	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
regnet	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
rembert	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
resnet	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
roberta	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
roformer	Skip RoFormer ONNX test if rjieba not installed (#16981)	2022-05-04 10:04:10 +02:00
segformer	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
sew	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
sew_d	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
speech_encoder_decoder	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
speech_to_text	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
speech_to_text_2	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
splinter	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
squeezebert	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
swin	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
t5	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
tapas	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
tapex	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
transfo_xl	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
trocr	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
unispeech	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
unispeech_sat	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
van	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
vilt	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
vision_encoder_decoder	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
vision_text_dual_encoder	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
visual_bert	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
vit	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
vit_mae	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
wav2vec2	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
wav2vec2_phoneme	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
wav2vec2_with_lm	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
wavlm	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
xglm	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
xlm	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
xlm_prophetnet	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
xlm_roberta	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
xlm_roberta_xl	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
xlnet	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
yolos	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
yoso	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00
__init__.py	Move test model folders (#17034)	2022-05-03 14:42:02 +02:00