riaz.somc/transformers
1
0
Fork 0
mirror of https://github.com/huggingface/transformers.git synced 2025-07-06 06:10:04 +06:00
Code Issues Actions 16 Packages Projects Releases Wiki Activity
3b3024da70
transformers/docs/source/en/model_doc
History
Matt 3b3024da70
TF port of ESM (#19587) 
* Partial TF port for ESM model

* Add ESM-TF tests

* Add the various imports for TF-ESM

* TF weight conversion almost ready

* Stop ignoring the decoder weights in PT

* Add tests and lots of fixes

* fix-copies

* Fix imports, add model docs

* Add get_vocab() to tokenizer

* Fix vocab links for pretrained files

* Allow multiple inputs with a sep

* Use EOS as SEP token because ESM vocab lacks SEP

* Correctly return special tokens mask from ESM tokenizer

* make fixup

* Stop testing unsupported embedding resizing

* Handle TF bias correctly

* Skip all models with slow tokenizers in the token classification test

* Fixing the batch/unbatcher of pipelines to accomodate the `None` being

passed around.

* Fixing pipeline bug caused by slow tokenizer  being different.

* Update src/transformers/models/esm/modeling_tf_esm.py

Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com>

* Update src/transformers/models/esm/modeling_tf_esm.py

Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com>

* Update src/transformers/models/esm/modeling_tf_esm.py

Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com>

* Update set_input_embeddings and the copyright notices

Co-authored-by: Your Name <you@example.com>
Co-authored-by: Nicolas Patry <patry.nicolas@protonmail.com>
Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com>
2022-10-17 14:16:16 +01:00
..
albert.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
auto.mdx Add depth estimation pipeline (#18618) 2022-10-12 08:54:20 -04:00
bart.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
barthez.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
bartpho.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
beit.mdx Beit postprocessing (#19099) 2022-09-20 10:41:56 +03:00
bert-generation.mdx Result of new doc style with fixes (#17015) 2022-04-29 17:42:15 -04:00
bert-japanese.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
bert.mdx Add a TF in-graph tokenizer for BERT (#17701) 2022-06-27 12:06:21 +01:00
bertweet.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
big_bird.mdx [FlaxBert] Add ForCausalLM (#16995) 2022-05-03 11:26:19 +02:00
bigbird_pegasus.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
blenderbot-small.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
blenderbot.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
bloom.mdx Add BloomForQuestionAnswering (#19310) 2022-10-04 17:52:13 +02:00
bort.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
byt5.mdx [Doctests] Fix all T5 doc tests (#16646) 2022-04-13 11:36:54 +02:00
camembert.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
canine.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
clip.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
codegen.mdx Add CodeGen model (#17443) 2022-06-24 17:10:38 +02:00
conditional_detr.mdx Improve conditional detr docs (#19154) 2022-09-22 13:21:05 +02:00
convbert.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
convnext.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
cpm.mdx Allow all imports from transformers (#17050) 2022-05-02 12:47:39 -04:00
ctrl.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
cvt.mdx [CvT] Tensorflow implementation (#18597) 2022-10-11 18:16:52 +01:00
data2vec.mdx Add TFData2VecVision for semantic segmentation (#17271) 2022-06-08 14:03:18 +01:00
deberta-v2.mdx Add DebertaV2ForMultipleChoice (#17135) 2022-05-10 16:21:44 -04:00
deberta.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
decision_transformer.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
deformable_detr.mdx [fix] Add DeformableDetrFeatureExtractor (#19140) 2022-09-22 09:45:24 +02:00
deit.mdx Add TF DeiT implementation (#17806) 2022-07-13 18:04:08 +01:00
detr.mdx fix docs example, add object_detection to DETR docs (#19377) 2022-10-07 00:02:26 +02:00
dialogpt.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
distilbert.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
dit.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
donut.mdx Fix URLs (#18604) 2022-08-12 18:52:49 +02:00
dpr.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
dpt.mdx Add post_process_semantic_segmentation method to DPTFeatureExtractor (#19107) 2022-09-21 15:15:26 +03:00
electra.mdx [FlaxBert] Add ForCausalLM (#16995) 2022-05-03 11:26:19 +02:00
encoder-decoder.mdx [EncoderDecoder] Improve docs (#18271) 2022-07-27 10:08:59 +02:00
ernie.mdx add task_type_id to BERT to support ERNIE-2.0 and ERNIE-3.0 models (#18686) 2022-09-09 07:36:46 -04:00
esm.mdx TF port of ESM (#19587) 2022-10-17 14:16:16 +01:00
flaubert.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
flava.mdx [feat] Add FLAVA model (#16654) 2022-05-11 14:56:48 -07:00
fnet.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
fsmt.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
funnel.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
glpn.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
gpt_neo.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
gpt_neox_japanese.mdx Add support for Japanese GPT-NeoX-based model by ABEJA, Inc. (#18814) 2022-09-14 10:17:40 -04:00
gpt_neox.mdx [WIP] Adding GPT-NeoX-20B (#16659) 2022-05-24 09:31:10 -04:00
gpt2.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
gptj.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
groupvit.mdx [TensorFlow] Adding GroupViT (#18020) 2022-09-29 10:48:04 +01:00
herbert.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
hubert.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
ibert.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
imagegpt.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
layoutlm.mdx [LayoutLM] Add clarification to docs (#18716) 2022-09-02 14:48:19 +02:00
layoutlmv2.mdx Correct & Improve Doctests for LayoutLMv2 (#17168) 2022-05-23 08:02:31 -04:00
layoutlmv3.mdx [LayoutLMv3] Add TensorFlow implementation (#18678) 2022-08-30 11:48:11 +01:00
layoutxlm.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
led.mdx [LED] fix global_attention_mask not being passed for generation and docs clarification about grad checkpointing (#17112) 2022-05-17 23:44:37 +02:00
levit.mdx Adding LeViT Model by Facebook (#17466) 2022-06-01 17:06:20 +02:00
lilt.mdx Add LiLT (#19450) 2022-10-12 10:11:20 +02:00
longformer.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
longt5.mdx Update longt5.mdx (#18634) 2022-08-16 10:20:46 -05:00
luke.mdx Adding fine-tuning models to LUKE (#18353) 2022-08-01 11:09:47 -04:00
lxmert.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
m2m_100.mdx Fix m2m_100.mdx doc example missing labels (#19149) 2022-09-29 13:27:58 +02:00
marian.mdx Replace as_target context managers by direct calls (#18325) 2022-07-29 08:09:09 -04:00
markuplm.mdx fix MarkupLMProcessor option flag (#19526) 2022-10-12 15:08:48 +02:00
maskformer.mdx Maskformer post-processing fixes and improvements (#19172) 2022-10-05 15:27:15 +03:00
mbart.mdx Replace as_target context managers by direct calls (#18325) 2022-07-29 08:09:09 -04:00
mctct.mdx Replace as_target context managers by direct calls (#18325) 2022-07-29 08:09:09 -04:00
megatron_gpt2.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
megatron-bert.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
mluke.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
mobilebert.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
mobilevit.mdx Add semantic segmentation post-processing method to MobileViT (#19105) 2022-09-23 16:24:28 +03:00
mpnet.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
mt5.mdx Flax t5 Encoder (#17784) 2022-06-30 00:49:02 +02:00
mvp.mdx Add MVP model (#17787) 2022-06-29 09:30:55 -04:00
nezha.mdx Nezha Pytorch implementation (#17776) 2022-06-23 12:36:22 -04:00
nllb.mdx Replace as_target context managers by direct calls (#18325) 2022-07-29 08:09:09 -04:00
nystromformer.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
openai-gpt.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
opt.mdx Add OPTForQuestionAnswering (#19402) 2022-10-10 09:30:59 -04:00
owlvit.mdx fix owlvit tests, update docstring examples (#18586) 2022-08-11 19:10:25 +03:00
pegasus_x.mdx PEGASUS-X (#18551) 2022-09-02 19:54:02 +02:00
pegasus.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
perceiver.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
phobert.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
plbart.mdx Replace as_target context managers by direct calls (#18325) 2022-07-29 08:09:09 -04:00
poolformer.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
prophetnet.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
qdqbert.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
rag.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
realm.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
reformer.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
regnet.mdx TF implementation of RegNets (#17554) 2022-06-29 13:45:14 +01:00
rembert.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
resnet.mdx Add TF ResNet model (#17427) 2022-07-04 10:59:15 +01:00
retribert.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
roberta.mdx [FlaxBert] Add ForCausalLM (#16995) 2022-05-03 11:26:19 +02:00
roformer.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
segformer.mdx Add post_process_semantic_segmentation method to SegFormer (#19072) 2022-09-21 11:40:35 +03:00
sew-d.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
sew.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
speech_to_text_2.mdx Replace as_target context managers by direct calls (#18325) 2022-07-29 08:09:09 -04:00
speech_to_text.mdx Replace as_target context managers by direct calls (#18325) 2022-07-29 08:09:09 -04:00
speech-encoder-decoder.mdx Replace as_target context managers by direct calls (#18325) 2022-07-29 08:09:09 -04:00
splinter.mdx Add support for pretraining recurring span selection to Splinter (#17247) 2022-05-17 23:42:14 +02:00
squeezebert.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
swin.mdx Add Tensorflow Swin model (#16988) 2022-05-16 22:19:53 +01:00
swinv2.mdx Add swin transformer v2 (#17469) 2022-07-27 11:14:47 -04:00
t5.mdx Fix decode_input_ids to bare T5Model and improve doc (#18791) 2022-09-06 14:12:26 +02:00
t5v1.1.mdx [Doctests] Fix all T5 doc tests (#16646) 2022-04-13 11:36:54 +02:00
tapas.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
tapex.mdx Add TAPEX (#16473) 2022-04-08 10:57:51 +02:00
time_series_transformer.mdx time series forecasting model (#17965) 2022-09-30 15:32:59 -04:00
trajectory_transformer.mdx Add trajectory transformer (#17141) 2022-05-17 19:07:43 -04:00
transfo-xl.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
trocr.mdx Replace as_target context managers by direct calls (#18325) 2022-07-29 08:09:09 -04:00
ul2.mdx Add UL2 (just docs) (#17740) 2022-06-21 10:24:50 +02:00
unispeech-sat.mdx Add Wav2Vec2Conformer (#16812) 2022-05-17 00:43:16 +02:00
unispeech.mdx Add Wav2Vec2Conformer (#16812) 2022-05-17 00:43:16 +02:00
van.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
videomae.mdx Add VideoMAE (#17821) 2022-08-04 18:02:55 +02:00
vilt.mdx Add ViltForTokenClassification e.g. for Named-Entity-Recognition (NER) (#17924) 2022-07-26 10:11:32 +02:00
vision-encoder-decoder.mdx [EncoderDecoder] Improve docs (#18271) 2022-07-27 10:08:59 +02:00
vision-text-dual-encoder.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
visual_bert.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
vit_mae.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
vit_msn.mdx MSN (Masked Siamese Networks) for ViT (#18815) 2022-09-22 07:15:03 -04:00
vit.mdx Improve vision models docs (#19103) 2022-09-19 19:22:34 +02:00
wav2vec2_phoneme.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
wav2vec2-conformer.mdx [Wav2Vec2Conformer] Official release (#17709) 2022-06-15 18:34:15 +02:00
wav2vec2.mdx Replace as_target context managers by direct calls (#18325) 2022-07-29 08:09:09 -04:00
wavlm.mdx Add Wav2Vec2Conformer (#16812) 2022-05-17 00:43:16 +02:00
whisper.mdx add a note to whisper docs clarifying support of long-form decoding (#19497) 2022-10-13 10:39:03 +02:00
xclip.mdx Improve vision models docs (#19103) 2022-09-19 19:22:34 +02:00
xglm.mdx Add TF implementation of XGLMModel (#16543) 2022-08-24 10:51:05 +01:00
xlm-prophetnet.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
xlm-roberta-xl.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
xlm-roberta.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
xlm.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
xlnet.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
xls_r.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
xlsr_wav2vec2.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00
yolos.mdx Add YOLOS (#16848) 2022-05-02 18:30:55 +02:00
yoso.mdx Enable doc in Spanish (#16518) 2022-04-04 10:25:46 -04:00