riaz.somc/transformers
1
0
Fork 0
mirror of https://github.com/huggingface/transformers.git synced 2025-07-19 20:48:22 +06:00
Code Issues Actions 18 Packages Projects Releases Wiki Activity
dd6fb1319b
transformers/tests/models
History
Yang An 721764028e
Add Chinese-CLIP implementation (#20368) 
* init chinese-clip model from clip

* init model tests and docs

* implement chinese-clip into hf

* implement chinese-clip into hf

* implement chinese-clip into hf

* implement chinese-clip into hf

* implement chinese-clip into hf

* update usecase example in model implementation

* fix codestyle

* fix model_type typo in readme

* add placeholder in doc

* add placeholder in doc

* update the init script

* update usecase

* fix codestyle

* update testcase

* update testcase

* update testcase

* update testcase

* update testcase

* update testcase

* update testcase

* update testcase

* update testcase

* update testcase

* update testcase

* update testcase

* forward the convert_rgb

* update testcase

* update testcase

* update testcase

* merge the recent update from clip about model_input_name property

* update the doc

* update the doc

* update the doc

* update the doc

* remove unused imports

* reformat code style

* update the doc

* fix isort style

* bypass a weird failed unit test which is unrelated with my PR

* update the doc

* implement independent vision config class

* implement independent vision model class

* fix refactor bug

* fix refactor bug

* fix refactor bug

* make style

* fix refactor bug

* make style

* fix refactor bug

* fix refactor bug

* make style

* fix refactor bug

* fix refactor bug

* doc-build restyle

* implement independent text config class

* implement independent text model class

* implement independent text model class

* make style

* make fix-copies

* fix refactor bug

* fix refactor bug

* fix refactor bug

* fix refactor bug

* fix refactor bug

* fix refactor bug

* fix refactor bug

* fix refactor bug

* fix refactor bug

* fix refactor bug

* make style

* update doc

* black and isort

* update doc

* Update src/transformers/models/chinese_clip/configuration_chinese_clip.py

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* Update src/transformers/models/auto/tokenization_auto.py

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* modify the model type from chinese-clip to chinese_clip

* format the example comment of ChineseCLIPVisionConfig

* correct the copyright comment

* fix the tokenizer specification

* add copied from for loss function

* remove unused class

* update CHINESE_CLIP_TEXT_INPUTS_DOCSTRING

* update CHINESE_CLIP_INPUTS_DOCSTRING

* update doc

* update doc

* update code comment in config

* update copied from statement

* make style

* rename the doc file

* add copied statement

* remove unused attention_mask, causal_attention_mask in ChineseCLIPVisionEncoder

* remove ChineseCLIPTextPreTrainedModel

* fix bug

* fix bug

* fix bug

* update doc

* make style

* Update src/transformers/models/chinese_clip/configuration_chinese_clip.py

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* Update src/transformers/models/chinese_clip/configuration_chinese_clip.py

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* update ChineseCLIPImageProcessor in image_processing_auto

* fix config_class of chinesecliptextmodel

* fix the test case

* update the docs

* remove the copied from comment for ChineseCLIPTextModel, since it has diverged from BertModel with customed config_class

* update the testcase

* final fix

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
2022-11-30 19:22:23 +01:00
..
albert Improve model tester (#19984) 2022-11-02 17:38:44 +01:00
audio_spectrogram_transformer Add Audio Spectogram Transformer (#19981) 2022-11-21 18:58:54 +01:00
auto Fix tapas scatter (#20149) 2022-11-14 01:04:26 -05:00
bart Enable PyTorch 1.13 (#20168) 2022-11-15 11:33:09 -05:00
barthez Move test model folders (#17034) 2022-05-03 14:42:02 +02:00
bartpho Move test model folders (#17034) 2022-05-03 14:42:02 +02:00
beit Add Image Processors (#19796) 2022-11-02 11:57:36 +00:00
bert update relative positional embedding (#20203) 2022-11-15 10:46:34 +01:00
bert_generation Generate: move generation_*.py src files into generation/*.py (#20096) 2022-11-09 15:34:08 +00:00
bert_japanese Add sentencepiece to BertJapaneseTokenizer (#19769) 2022-10-21 10:04:49 -04:00
bertweet Move test model folders (#17034) 2022-05-03 14:42:02 +02:00
big_bird wrap forward passes with torch.no_grad() (#19273) 2022-10-04 16:13:22 +02:00
bigbird_pegasus Generate: move generation_*.py src files into generation/*.py (#20096) 2022-11-09 15:34:08 +00:00
blenderbot Generate: move generation_*.py src files into generation/*.py (#20096) 2022-11-09 15:34:08 +00:00
blenderbot_small Generate: move generation_*.py src files into generation/*.py (#20096) 2022-11-09 15:34:08 +00:00
bloom Generate: move generation_*.py src files into generation/*.py (#20096) 2022-11-09 15:34:08 +00:00
bort Move test model folders (#17034) 2022-05-03 14:42:02 +02:00
byt5 Replace as_target context managers by direct calls (#18325) 2022-07-29 08:09:09 -04:00
camembert Move test model folders (#17034) 2022-05-03 14:42:02 +02:00
canine Improve model tester (#19984) 2022-11-02 17:38:44 +01:00
chinese_clip Add Chinese-CLIP implementation (#20368) 2022-11-30 19:22:23 +01:00
clip [CLIP] allow loading projection layer in vision and text model (#18962) 2022-11-15 17:50:07 +01:00
clipseg Fix device issues in CLIPSegModelIntegrationTest (#20467) 2022-11-28 10:41:28 +01:00
codegen Generate: move generation_*.py src files into generation/*.py (#20096) 2022-11-09 15:34:08 +00:00
conditional_detr Add segmentation + object detection image processors (#20160) 2022-11-30 10:24:03 +00:00
convbert wrap forward passes with torch.no_grad() (#19274) 2022-10-04 16:12:03 +02:00
convnext Add Image Processors (#19796) 2022-11-02 11:57:36 +00:00
cpm Move test model folders (#17034) 2022-05-03 14:42:02 +02:00
ctrl Generate: move generation_*.py src files into generation/*.py (#20096) 2022-11-09 15:34:08 +00:00
cvt [CvT] Tensorflow implementation (#18597) 2022-10-11 18:16:52 +01:00
data2vec update relative positional embedding (#20203) 2022-11-15 10:46:34 +01:00
deberta fix train_new_from_iterator in the case of byte-level tokenizers (#17549) 2022-06-08 15:30:41 +02:00
deberta_v2 🚨 🚨 🚨 Fix Issue 15003: SentencePiece Tokenizers Not Adding Special Tokens in convert_tokens_to_string (#15775) 2022-11-02 15:45:38 -04:00
decision_transformer Generate: move generation_*.py src files into generation/*.py (#20096) 2022-11-09 15:34:08 +00:00
deformable_detr Add segmentation + object detection image processors (#20160) 2022-11-30 10:24:03 +00:00
deit Add accelerate support for ViT family (#20174) 2022-11-15 11:06:01 +01:00
detr Add segmentation + object detection image processors (#20160) 2022-11-30 10:24:03 +00:00
dinat Add Neighborhood Attention Transformer (NAT) and Dilated NAT (DiNAT) models (#20219) 2022-11-18 13:08:26 -05:00
distilbert Move test model folders (#17034) 2022-05-03 14:42:02 +02:00
dit Move test model folders (#17034) 2022-05-03 14:42:02 +02:00
donut Add Donut image processor (#20425) 2022-11-29 10:38:01 +00:00
dpr Replace as_target context managers by direct calls (#18325) 2022-07-29 08:09:09 -04:00
dpt Add Image Processors (#19796) 2022-11-02 11:57:36 +00:00
electra Improve model tester (#19984) 2022-11-02 17:38:44 +01:00
encoder_decoder Generate: move generation_*.py src files into generation/*.py (#20096) 2022-11-09 15:34:08 +00:00
ernie update relative positional embedding (#20203) 2022-11-15 10:46:34 +01:00
esm Fix ESM checkpoints for tests (#20436) 2022-11-28 13:19:28 +00:00
flaubert Improve model tester (#19984) 2022-11-02 17:38:44 +01:00
flava Fix type - update any PIL.Image.Resampling (#20172) 2022-11-11 16:55:59 +00:00
fnet wrap forward passes with torch.no_grad() (#19413) 2022-10-10 15:03:46 -04:00
fsmt Generate: move generation_*.py src files into generation/*.py (#20096) 2022-11-09 15:34:08 +00:00
funnel Update serving code to enable saved_model=True (#18153) 2022-07-22 18:05:38 +01:00
glpn Move test model folders (#17034) 2022-05-03 14:42:02 +02:00
gpt_neo Generate: move generation_*.py src files into generation/*.py (#20096) 2022-11-09 15:34:08 +00:00
gpt_neox skip some gpt_neox tests that require 80G RAM (#17923) 2022-07-01 09:04:38 -04:00
gpt_neox_japanese Add support for Japanese GPT-NeoX-based model by ABEJA, Inc. (#18814) 2022-09-14 10:17:40 -04:00
gpt2 Fix TF nightly tests (#20507) 2022-11-30 14:47:54 +00:00
gptj Generate: move generation_*.py src files into generation/*.py (#20096) 2022-11-09 15:34:08 +00:00
groupvit Allow passing arguments to model testers for CLIP-like models (#20044) 2022-11-04 18:01:41 +01:00
herbert Move test model folders (#17034) 2022-05-03 14:42:02 +02:00
hubert Fix train_step, test_step and tests for CLIP (#18684) 2022-09-09 20:01:02 +01:00
ibert Improve model tester (#19984) 2022-11-02 17:38:44 +01:00
imagegpt Generate: move generation_*.py src files into generation/*.py (#20096) 2022-11-09 15:34:08 +00:00
jukebox Add Jukebox model (replaces #16875) (#17826) 2022-11-10 21:05:27 +01:00
layoutlm TF: TF 2.10 unpin + related onnx test skips (#18995) 2022-09-12 19:30:27 +01:00
layoutlmv2 [processor] Add 'model input names' property (#20117) 2022-11-10 19:29:20 +00:00
layoutlmv3 [processor] Add 'model input names' property (#20117) 2022-11-10 19:29:20 +00:00
layoutxlm Fix tapas scatter (#20149) 2022-11-14 01:04:26 -05:00
led Generate: move generation_*.py src files into generation/*.py (#20096) 2022-11-09 15:34:08 +00:00
levit Add Image Processors (#19796) 2022-11-02 11:57:36 +00:00
lilt Generate: move generation_*.py src files into generation/*.py (#20096) 2022-11-09 15:34:08 +00:00
longformer Improve model tester (#19984) 2022-11-02 17:38:44 +01:00
longt5 Generate: move generation_*.py src files into generation/*.py (#20096) 2022-11-09 15:34:08 +00:00
luke Adding fine-tuning models to LUKE (#18353) 2022-08-01 11:09:47 -04:00
lxmert Update serving code to enable saved_model=True (#18153) 2022-07-22 18:05:38 +01:00
m2m_100 Generate: move generation_*.py src files into generation/*.py (#20096) 2022-11-09 15:34:08 +00:00
marian Generate: move generation_*.py src files into generation/*.py (#20096) 2022-11-09 15:34:08 +00:00
markuplm [processor] Add 'model input names' property (#20117) 2022-11-10 19:29:20 +00:00
maskformer Add segmentation + object detection image processors (#20160) 2022-11-30 10:24:03 +00:00
mbart Enable PyTorch 1.13 (#20168) 2022-11-15 11:33:09 -05:00
mbart50 Replace as_target context managers by direct calls (#18325) 2022-07-29 08:09:09 -04:00
mctct [processor] Add 'model input names' property (#20117) 2022-11-10 19:29:20 +00:00
megatron_bert Move test model folders (#17034) 2022-05-03 14:42:02 +02:00
megatron_gpt2 Move test model folders (#17034) 2022-05-03 14:42:02 +02:00
mluke Black preview (#17217) 2022-05-12 16:25:55 -04:00
mobilebert Fix train_step, test_step and tests for CLIP (#18684) 2022-09-09 20:01:02 +01:00
mobilenet_v1 add MobileNetV1 model (#17799) 2022-11-21 10:21:28 -05:00
mobilenet_v2 add MobileNetV2 model (#17845) 2022-11-14 01:00:10 -05:00
mobilevit Add Image Processors (#19796) 2022-11-02 11:57:36 +00:00
mpnet Move test model folders (#17034) 2022-05-03 14:42:02 +02:00
mt5 Fix expected loss values in some (m)T5 tests (#18177) 2022-07-18 15:26:21 +02:00
mvp Generate: move generation_*.py src files into generation/*.py (#20096) 2022-11-09 15:34:08 +00:00
nat Add Neighborhood Attention Transformer (NAT) and Dilated NAT (DiNAT) models (#20219) 2022-11-18 13:08:26 -05:00
nezha Generate: move generation_*.py src files into generation/*.py (#20096) 2022-11-09 15:34:08 +00:00
nllb Replace as_target context managers by direct calls (#18325) 2022-07-29 08:09:09 -04:00
nystromformer Move test model folders (#17034) 2022-05-03 14:42:02 +02:00
openai Generate: move generation_*.py src files into generation/*.py (#20096) 2022-11-09 15:34:08 +00:00
opt Generate: move generation_*.py src files into generation/*.py (#20096) 2022-11-09 15:34:08 +00:00
owlvit Add segmentation + object detection image processors (#20160) 2022-11-30 10:24:03 +00:00
pegasus Generate: move generation_*.py src files into generation/*.py (#20096) 2022-11-09 15:34:08 +00:00
pegasus_x Generate: move generation_*.py src files into generation/*.py (#20096) 2022-11-09 15:34:08 +00:00
perceiver Update defaults and logic to match old FE (#20065) 2022-11-04 19:14:56 +00:00
phobert Move test model folders (#17034) 2022-05-03 14:42:02 +02:00
plbart Generate: fix plbart generation tests (#20391) 2022-11-22 17:56:04 +00:00
poolformer Add Image Processors (#19796) 2022-11-02 11:57:36 +00:00
prophetnet Generate: move generation_*.py src files into generation/*.py (#20096) 2022-11-09 15:34:08 +00:00
qdqbert Move test model folders (#17034) 2022-05-03 14:42:02 +02:00
rag Avoid GPU OOM for a TF Rag test (#17638) 2022-06-10 18:50:29 +02:00
realm Black preview (#17217) 2022-05-12 16:25:55 -04:00
reformer Generate: move generation_*.py src files into generation/*.py (#20096) 2022-11-09 15:34:08 +00:00
regnet Run tests if skip condition not met (#18764) 2022-08-30 14:03:28 +02:00
rembert Move test model folders (#17034) 2022-05-03 14:42:02 +02:00
resnet [AutoBackbone] Improve API (#20407) 2022-11-28 17:20:24 +01:00
retribert fix retribert's test_torch_encode_plus_sent_to_model (#17231) 2022-05-17 14:33:13 +02:00
roberta update relative positional embedding (#20203) 2022-11-15 10:46:34 +01:00
roc_bert fix both failing RoCBert tests (#20469) 2022-11-28 17:08:57 +01:00
roformer wrap forward passes with torch.no_grad() (#19438) 2022-10-10 14:54:54 -04:00
segformer Add Image Processors (#19796) 2022-11-02 11:57:36 +00:00
sew Move test model folders (#17034) 2022-05-03 14:42:02 +02:00
sew_d Move test model folders (#17034) 2022-05-03 14:42:02 +02:00
speech_encoder_decoder Generate: move generation_*.py src files into generation/*.py (#20096) 2022-11-09 15:34:08 +00:00
speech_to_text [processor] Add 'model input names' property (#20117) 2022-11-10 19:29:20 +00:00
speech_to_text_2 Generate: move generation_*.py src files into generation/*.py (#20096) 2022-11-09 15:34:08 +00:00
splinter Fix Splinter test (#17854) 2022-06-24 16:26:14 +02:00
squeezebert Move test model folders (#17034) 2022-05-03 14:42:02 +02:00
swin remvoe _create_and_check_torch_fx_tracing in specific test files (#18667) 2022-09-07 16:22:09 +02:00
swinv2 Add swin transformer v2 (#17469) 2022-07-27 11:14:47 -04:00
switch_transformers [Switch Transformers] Fix failing slow test (#20346) 2022-11-21 15:36:49 +01:00
t5 [FLAX] Add dtype to embedding for bert/bart/opt/t5 (#20340) 2022-11-28 10:21:42 -05:00
table_transformer Generate: move generation_*.py src files into generation/*.py (#20096) 2022-11-09 15:34:08 +00:00
tapas Fix tapas scatter (#20149) 2022-11-14 01:04:26 -05:00
tapex Replace as_target context managers by direct calls (#18325) 2022-07-29 08:09:09 -04:00
time_series_transformer Add a decorator for flaky tests (#19498) 2022-10-12 14:00:17 -04:00
trajectory_transformer Generate: move generation_*.py src files into generation/*.py (#20096) 2022-11-09 15:34:08 +00:00
transfo_xl Generate: move generation_*.py src files into generation/*.py (#20096) 2022-11-09 15:34:08 +00:00
trocr Generate: move generation_*.py src files into generation/*.py (#20096) 2022-11-09 15:34:08 +00:00
unispeech Move test model folders (#17034) 2022-05-03 14:42:02 +02:00
unispeech_sat Move test model folders (#17034) 2022-05-03 14:42:02 +02:00
van has_attentions - consistent test skipping logic and tf tests (#17495) 2022-06-09 09:50:03 +02:00
videomae Add Image Processors (#19796) 2022-11-02 11:57:36 +00:00
vilt Add Image Processors (#19796) 2022-11-02 11:57:36 +00:00
vision_encoder_decoder Generate: move generation_*.py src files into generation/*.py (#20096) 2022-11-09 15:34:08 +00:00
vision_text_dual_encoder [processor] Add 'model input names' property (#20117) 2022-11-10 19:29:20 +00:00
visual_bert wrap forward passes with torch.no_grad() (#19439) 2022-10-10 14:54:36 -04:00
vit Add accelerate support for ViT family (#20174) 2022-11-15 11:06:01 +01:00
vit_mae TF: tests for (de)serializable models with resized tokens (#19013) 2022-09-16 16:38:08 +01:00
vit_msn Some fixes regarding auto mappings and test class names (#19923) 2022-10-27 14:38:59 +02:00
wav2vec2 [processor] Add 'model input names' property (#20117) 2022-11-10 19:29:20 +00:00
wav2vec2_conformer [Test] Fix W2V-Conformer integration test (#17303) 2022-05-17 18:20:36 +02:00
wav2vec2_phoneme Move test model folders (#17034) 2022-05-03 14:42:02 +02:00
wav2vec2_with_lm [processor] Add 'model input names' property (#20117) 2022-11-10 19:29:20 +00:00
wavlm Move test model folders (#17034) 2022-05-03 14:42:02 +02:00
whisper Expected output for the test changed (#20493) 2022-11-30 15:07:28 +01:00
x_clip Allow passing arguments to model testers for CLIP-like models (#20044) 2022-11-04 18:01:41 +01:00
xglm Generate: move generation_*.py src files into generation/*.py (#20096) 2022-11-09 15:34:08 +00:00
xlm Generate: move generation_*.py src files into generation/*.py (#20096) 2022-11-09 15:34:08 +00:00
xlm_prophetnet Black preview (#17217) 2022-05-12 16:25:55 -04:00
xlm_roberta Black preview (#17217) 2022-05-12 16:25:55 -04:00
xlm_roberta_xl update relative positional embedding (#20203) 2022-11-15 10:46:34 +01:00
xlnet Generate: move generation_*.py src files into generation/*.py (#20096) 2022-11-09 15:34:08 +00:00
yolos Add segmentation + object detection image processors (#20160) 2022-11-30 10:24:03 +00:00
yoso fix train_new_from_iterator in the case of byte-level tokenizers (#17549) 2022-06-08 15:30:41 +02:00
__init__.py Move test model folders (#17034) 2022-05-03 14:42:02 +02:00