mirror of
https://github.com/huggingface/transformers.git
synced 2025-07-30 17:52:35 +06:00
3b3024da70
* Partial TF port for ESM model * Add ESM-TF tests * Add the various imports for TF-ESM * TF weight conversion almost ready * Stop ignoring the decoder weights in PT * Add tests and lots of fixes * fix-copies * Fix imports, add model docs * Add get_vocab() to tokenizer * Fix vocab links for pretrained files * Allow multiple inputs with a sep * Use EOS as SEP token because ESM vocab lacks SEP * Correctly return special tokens mask from ESM tokenizer * make fixup * Stop testing unsupported embedding resizing * Handle TF bias correctly * Skip all models with slow tokenizers in the token classification test * Fixing the batch/unbatcher of pipelines to accomodate the `None` being passed around. * Fixing pipeline bug caused by slow tokenizer being different. * Update src/transformers/models/esm/modeling_tf_esm.py Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com> * Update src/transformers/models/esm/modeling_tf_esm.py Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com> * Update src/transformers/models/esm/modeling_tf_esm.py Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com> * Update set_input_embeddings and the copyright notices Co-authored-by: Your Name <you@example.com> Co-authored-by: Nicolas Patry <patry.nicolas@protonmail.com> Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com> |
||
|---|---|---|
| .. | ||
| __init__.py | ||
| test_pipelines_audio_classification.py | ||
| test_pipelines_automatic_speech_recognition.py | ||
| test_pipelines_common.py | ||
| test_pipelines_conversational.py | ||
| test_pipelines_depth_estimation.py | ||
| test_pipelines_document_question_answering.py | ||
| test_pipelines_feature_extraction.py | ||
| test_pipelines_fill_mask.py | ||
| test_pipelines_image_classification.py | ||
| test_pipelines_image_segmentation.py | ||
| test_pipelines_image_to_text.py | ||
| test_pipelines_object_detection.py | ||
| test_pipelines_question_answering.py | ||
| test_pipelines_summarization.py | ||
| test_pipelines_table_question_answering.py | ||
| test_pipelines_text_classification.py | ||
| test_pipelines_text_generation.py | ||
| test_pipelines_text2text_generation.py | ||
| test_pipelines_token_classification.py | ||
| test_pipelines_translation.py | ||
| test_pipelines_visual_question_answering.py | ||
| test_pipelines_zero_shot_image_classification.py | ||
| test_pipelines_zero_shot_object_detection.py | ||
| test_pipelines_zero_shot.py | ||