transformers/tests/models
s-JoL c2c99dc7ef
add open-llama model with ckpt (#22795)
* update Open-Llama model

* update

* update format

* update doc

* update

* update stable embedding test

* update test case

* update format

* update readme

* fix typo

* update name

* remove tokenizer and update format

* remove convert_open_llama_weights_to_hf

* update warning and doc_string

---------

Co-authored-by: songliang.bayesian <songliang.bayesian@bytedance.com>
2023-04-28 11:01:32 -04:00
..
albert 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
align update_pip_test_mapping (#22606) 2023-04-06 17:56:06 +02:00
altclip Automatically create/update tiny models (#22275) 2023-03-23 19:14:17 +01:00
audio_spectrogram_transformer Automatically create/update tiny models (#22275) 2023-03-23 19:14:17 +01:00
auto Use code on the Hub from another repo (#22814) 2023-04-18 13:46:11 -04:00
bart Generate: pin number of beams in BART test (#22763) 2023-04-14 09:57:25 +01:00
barthez Update quality tooling for formatting (#21480) 2023-02-06 18:10:56 -05:00
bartpho Update quality tooling for formatting (#21480) 2023-02-06 18:10:56 -05:00
beit 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
bert 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
bert_generation 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
bert_japanese Update quality tooling for formatting (#21480) 2023-02-06 18:10:56 -05:00
bertweet Update quality tooling for formatting (#21480) 2023-02-06 18:10:56 -05:00
big_bird Skip pt/flax equivalence tests in pytorch bigbird test file (#23040) 2023-04-28 17:00:13 +02:00
bigbird_pegasus Generate: Add assisted generation (#22211) 2023-04-18 17:36:56 +01:00
biogpt added biogpt token classifier (#22447) 2023-04-03 09:20:02 -04:00
bit Backbone add mixin tests (#22542) 2023-04-06 13:50:15 +01:00
blenderbot update_pip_test_mapping (#22606) 2023-04-06 17:56:06 +02:00
blenderbot_small update_pip_test_mapping (#22606) 2023-04-06 17:56:06 +02:00
blip Fix docstrings for TF BLIP (#22618) 2023-04-12 17:46:41 +01:00
blip_2 [Blip2] skip accelerate test (#22124) 2023-03-13 15:03:21 +01:00
bloom Time to Say Goodbye, torch 1.7 and 1.8 (#22291) 2023-03-21 19:22:01 +01:00
bort Move test model folders (#17034) 2022-05-03 14:42:02 +02:00
bridgetower Update BridgeTowerModelTester (#23029) 2023-04-27 18:26:17 +02:00
byt5 Update quality tooling for formatting (#21480) 2023-02-06 18:10:56 -05:00
camembert Added with torch.no_grad() to Camembert integration test (#21544) 2023-02-10 10:58:29 +01:00
canine 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
chinese_clip 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
clap [CI] clap patch fusion test values (#22922) 2023-04-21 11:22:07 -04:00
clip 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
clipseg 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
codegen Decorate test_codegen_sample_max_time as flaky (#22953) 2023-04-24 15:27:31 +02:00
conditional_detr Skip test_multi_gpu_data_parallel_forward for some model tests (#21991) 2023-03-07 14:23:36 +01:00
convbert [ConvBert] Fix #21523 (#21849) 2023-03-01 11:11:04 +01:00
convnext Backbone add mixin tests (#22542) 2023-04-06 13:50:15 +01:00
convnextv2 update_pip_test_mapping (#22606) 2023-04-06 17:56:06 +02:00
cpm Fix PipelineTests skip conditions (#22320) 2023-03-22 20:02:24 +01:00
cpmant add model resources for CPMAnt (new) (#20906) 2023-04-12 07:33:20 -04:00
ctrl Move is_pipeline_test_to_skip to specific model test classes (#21999) 2023-03-14 10:03:02 +01:00
cvt Fix error in mixed precision training of TFCvtModel (#22267) 2023-03-21 12:12:57 +00:00
data2vec 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
deberta 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
deberta_v2 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
decision_transformer 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
deformable_detr 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
deit Add MaskedImageModelingOutput (#22212) 2023-03-22 07:35:47 +03:00
deta Revert (for now) the change on Deta in #22437 (#22750) 2023-04-13 21:32:29 +02:00
detr [DETR and friends] Remove is_timm_available (#21814) 2023-03-07 15:19:39 -05:00
dinat Backbone add mixin tests (#22542) 2023-04-06 13:50:15 +01:00
distilbert 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
dit Move test model folders (#17034) 2022-05-03 14:42:02 +02:00
donut 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
dpr 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
dpt 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
efficientformer 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
efficientnet Update tiny model summary file for recent models (#22637) 2023-04-06 22:52:59 +02:00
electra 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
encoder_decoder Update quality tooling for formatting (#21480) 2023-02-06 18:10:56 -05:00
ernie 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
ernie_m Automatically create/update tiny models (#22275) 2023-03-23 19:14:17 +01:00
esm Fix weight tying in TF-ESM (#22839) 2023-04-20 15:50:31 +01:00
flaubert Fix FillMaskPipelineTests (#22894) 2023-04-21 15:16:45 +02:00
flava 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
fnet Remove some pipeline skip cases (#22865) 2023-04-19 20:27:19 +02:00
focalnet Add FocalNet (#21532) 2023-04-23 20:03:05 +03:00
fsmt update_pip_test_mapping (#22606) 2023-04-06 17:56:06 +02:00
funnel 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
git 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
glpn 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
gpt_bigcode Update tiny models and a few fixes (#22928) 2023-04-24 14:45:22 +02:00
gpt_neo added GPTNeoForTokenClassification (#22908) 2023-04-27 12:10:03 -04:00
gpt_neox added GPTNeoXForTokenClassification (#23002) 2023-04-27 11:08:26 -04:00
gpt_neox_japanese 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
gpt_sw3 Add gpt-sw3 model to transformers (#20209) 2022-12-12 13:12:13 -05:00
gpt2 Revert "[GPT2] Propose fix for #21080" (#22093) 2023-03-10 22:08:21 +01:00
gptj Move is_pipeline_test_to_skip to specific model test classes (#21999) 2023-03-14 10:03:02 +01:00
gptsan_japanese Update tiny model summary file for recent models (#22637) 2023-04-06 22:52:59 +02:00
graphormer 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
groupvit 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
herbert Update quality tooling for formatting (#21480) 2023-02-06 18:10:56 -05:00
hubert Fix inverted conditional in TF common test! (#22540) 2023-04-04 21:59:54 +01:00
ibert 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
imagegpt 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
informer update_pip_test_mapping (#22606) 2023-04-06 17:56:06 +02:00
jukebox Update Jukebox tests (#21984) 2023-03-07 04:20:14 +01:00
layoutlm DocumentQuestionAnsweringPipeline only for fast tokenizers (#22745) 2023-04-13 17:22:59 +02:00
layoutlmv2 Don't use LayoutLMv2 and LayoutLMv3 in some pipeline tests (#22774) 2023-04-17 17:45:20 +02:00
layoutlmv3 Don't use LayoutLMv2 and LayoutLMv3 in some pipeline tests (#22774) 2023-04-17 17:45:20 +02:00
layoutxlm Apply ruff flake8-comprehensions (#21694) 2023-02-22 09:14:54 +01:00
led update_pip_test_mapping (#22606) 2023-04-06 17:56:06 +02:00
levit 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
lilt Move is_pipeline_test_to_skip to specific model test classes (#21999) 2023-03-14 10:03:02 +01:00
llama Adding Llama FastTokenizer support. (#22264) 2023-04-06 09:53:03 +02:00
longformer Move is_pipeline_test_to_skip to specific model test classes (#21999) 2023-03-14 10:03:02 +01:00
longt5 update_pip_test_mapping (#22606) 2023-04-06 17:56:06 +02:00
luke Fix PipelineTests skip conditions (#22320) 2023-03-22 20:02:24 +01:00
lxmert 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
m2m_100 update_pip_test_mapping (#22606) 2023-04-06 17:56:06 +02:00
marian update_pip_test_mapping (#22606) 2023-04-06 17:56:06 +02:00
markuplm Update some MarkupLM tests' expected values (#22667) 2023-04-11 10:00:34 +02:00
mask2former Fix quality due to ruff release 2023-03-22 20:45:08 -04:00
maskformer Backbone add mixin tests (#22542) 2023-04-06 13:50:15 +01:00
mbart Remove some pipeline skip cases (#22865) 2023-04-19 20:27:19 +02:00
mbart50 Replace as_target context managers by direct calls (#18325) 2022-07-29 08:09:09 -04:00
mctct Time to Say Goodbye, torch 1.7 and 1.8 (#22291) 2023-03-21 19:22:01 +01:00
mega Fix MegaModel CI (#22652) 2023-04-07 17:13:04 +02:00
megatron_bert 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
megatron_gpt2 Move test model folders (#17034) 2022-05-03 14:42:02 +02:00
mgp_str update_pip_test_mapping (#22606) 2023-04-06 17:56:06 +02:00
mluke Black preview (#17217) 2022-05-12 16:25:55 -04:00
mobilebert 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
mobilenet_v1 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
mobilenet_v2 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
mobilevit 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
mpnet 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
mt5 Update quality tooling for formatting (#21480) 2023-02-06 18:10:56 -05:00
mvp update_pip_test_mapping (#22606) 2023-04-06 17:56:06 +02:00
nat Backbone add mixin tests (#22542) 2023-04-06 13:50:15 +01:00
nezha 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
nllb 🚨🚨🚨 [NLLB Tokenizer] Fix the prefix tokens 🚨🚨🚨 (#22313) 2023-04-04 14:53:06 +02:00
nllb_moe tests: Fix flaky test for NLLB-MoE (#22880) 2023-04-21 17:09:40 +01:00
nystromformer 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
oneformer Automatically create/update tiny models (#22275) 2023-03-23 19:14:17 +01:00
open_llama add open-llama model with ckpt (#22795) 2023-04-28 11:01:32 -04:00
openai Fix PT-TF equivalence test for GPT1 (#22586) 2023-04-05 13:16:00 +01:00
opt [OPT] Fix default attention mask size (#22649) 2023-04-07 20:12:57 +02:00
owlvit 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
pegasus update_pip_test_mapping (#22606) 2023-04-06 17:56:06 +02:00
pegasus_x update_pip_test_mapping (#22606) 2023-04-06 17:56:06 +02:00
perceiver 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
phobert Update quality tooling for formatting (#21480) 2023-02-06 18:10:56 -05:00
pix2struct 🚨🚨🚨 [Pix2Struct] Attempts to fix training issues 🚨🚨🚨 (#23004) 2023-04-26 18:29:25 +02:00
plbart update_pip_test_mapping (#22606) 2023-04-06 17:56:06 +02:00
poolformer 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
prophetnet update_pip_test_mapping (#22606) 2023-04-06 17:56:06 +02:00
qdqbert 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
rag Tag tests as slow (#21537) 2023-02-09 14:46:15 +00:00
realm 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
reformer Move is_pipeline_test_to_skip to specific model test classes (#21999) 2023-03-14 10:03:02 +01:00
regnet Flax Regnet (#21867) 2023-04-04 12:41:12 -04:00
rembert 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
resnet Backbone add mixin tests (#22542) 2023-04-06 13:50:15 +01:00
retribert Update quality tooling for formatting (#21480) 2023-02-06 18:10:56 -05:00
roberta Skip a failing test on main for now (#22911) 2023-04-21 10:22:54 +02:00
roberta_prelayernorm 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
roc_bert Move is_pipeline_test_to_skip to specific model test classes (#21999) 2023-03-14 10:03:02 +01:00
roformer [Roformer] Fixing a bug in RoFormerEncoder where it was ignoring the length of past_key_values when generating as a decoder (#22416) 2023-04-04 12:50:33 +02:00
sam Update tiny models and a few fixes (#22928) 2023-04-24 14:45:22 +02:00
segformer 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
sew 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
sew_d 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
speech_encoder_decoder Update quality tooling for formatting (#21480) 2023-02-06 18:10:56 -05:00
speech_to_text 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
speech_to_text_2 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
speecht5 TTS fine-tuning for SpeechT5 (#21824) 2023-04-18 10:12:30 +01:00
splinter Make tiny model creation + pipeline testing more robust (#22500) 2023-04-06 17:45:55 +02:00
squeezebert 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
swin Backbone add mixin tests (#22542) 2023-04-06 13:50:15 +01:00
swin2sr Skip test_multi_gpu_data_parallel_forward for some model tests (#21991) 2023-03-07 14:23:36 +01:00
swinv2 Skip test_multi_gpu_data_parallel_forward for some model tests (#21991) 2023-03-07 14:23:36 +01:00
switch_transformers update_pip_test_mapping (#22606) 2023-04-06 17:56:06 +02:00
t5 update_pip_test_mapping (#22606) 2023-04-06 17:56:06 +02:00
table_transformer 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
tapas Move is_pipeline_test_to_skip to specific model test classes (#21999) 2023-03-14 10:03:02 +01:00
tapex Update quality tooling for formatting (#21480) 2023-02-06 18:10:56 -05:00
time_series_transformer [Time-Series] fix past_observed_mask type (#22076) 2023-04-03 09:07:21 -04:00
timesformer 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
trajectory_transformer Time to Say Goodbye, torch 1.7 and 1.8 (#22291) 2023-03-21 19:22:01 +01:00
transfo_xl Move is_pipeline_test_to_skip to specific model test classes (#21999) 2023-03-14 10:03:02 +01:00
trocr 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
tvlt 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
unispeech 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
unispeech_sat 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
upernet 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
van 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
videomae 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
vilt 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
vision_encoder_decoder Improve TF weight loading, especially PT crossloading (#21792) 2023-02-28 18:41:34 +00:00
vision_text_dual_encoder Add TFVisionTextDualEncoder (#21873) 2023-03-01 18:00:48 +00:00
visual_bert 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
vit Add MaskedImageModelingOutput (#22212) 2023-03-22 07:35:47 +03:00
vit_hybrid 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
vit_mae 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
vit_msn 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
wav2vec2 Add TensorFlow Wav2Vec2 for sequence classification (#22073) 2023-04-26 13:35:30 +01:00
wav2vec2_conformer 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
wav2vec2_phoneme Move test model folders (#17034) 2022-05-03 14:42:02 +02:00
wav2vec2_with_lm Fix test_word_time_stamp_integration for Wav2Vec2ProcessorWithLMTest (#22800) 2023-04-17 12:41:55 +02:00
wavlm 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
whisper Generate: Add assisted generation (#22211) 2023-04-18 17:36:56 +01:00
x_clip 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
xglm XGLM: Fix left-padding (PT and TF) (#22828) 2023-04-20 10:01:56 +01:00
xlm Fix FillMaskPipelineTests (#22894) 2023-04-21 15:16:45 +02:00
xlm_prophetnet Update expected values in XLMProphetNetModelIntegrationTest (#21957) 2023-03-06 09:15:44 +01:00
xlm_roberta Added with torch.no_grad() to XLM-Roberta integration test (#21547) 2023-02-09 21:49:54 +01:00
xlm_roberta_xl Use real tokenizers if tiny version(s) creation has issue(s) (#22428) 2023-03-29 16:16:23 +02:00
xlnet Remove some pipeline skip cases (#22865) 2023-04-19 20:27:19 +02:00
xmod Use real tokenizers if tiny version(s) creation has issue(s) (#22428) 2023-03-29 16:16:23 +02:00
yolos [DETR, YOLOS] Fix device bug (#21974) 2023-03-07 07:34:04 -05:00
yoso 🔥Rework pipeline testing by removing PipelineTestCaseMeta 🚀 (#21516) 2023-02-28 19:40:57 +01:00
__init__.py Move test model folders (#17034) 2022-05-03 14:42:02 +02:00