mirror of
https://github.com/huggingface/transformers.git
synced 2025-07-13 09:40:06 +06:00

* first raw version of the bark integration * working code on small models with single run * add converting script from suno weights 2 hf * many changes * correct past_kv output * working implementation for inference * update the converting script according to the architecture changes * add a working end-to-end inference code * remove some comments and make small changes * remove unecessary comment * add docstrings and ensure no unecessary intermediary output during audio generation * remove done TODOs * make style + add config docstrings * modification for batch inference support on the whole model * add details to .generation_audio method * add copyright * convert EncodecModel from original library to transformers implementation * add two class in order to facilitate model and sub-models loading from the hub * add support of loading the whole model * add BarkProcessor * correct modeling according to processor output * Add proper __init__ and auto support * Add up-to-date copyright/license message * add relative import instead of absolute * cleaner head_dim computation * small comment removal or changes * more verbose LayerNorm init method * specify eps for clearer comprehension * more verbose variable naming in the MLP module * remove unecessary BarkBlock parameter * clearer code in the forward pass of the BarkBlock * remove _initialize_modules method for cleaner code * Remove unnecessary methods from sub-models * move code to remove unnecessary function * rename a variable for clarity and change an assert * move code and change variable name for clarity * remove unnecessary asserts * correct small bug * correct a comment * change variable names for clarity * remove asserts * change import from absolute to relative * correct small error due to comma missing + correct import * Add attribute Bark config * add first version of tests * update attention_map * add tie_weights and resize_token_embeddings for fineModel * correct getting attention_mask in generate_text_semantic * remove Bark inference trick * leave more choices in barkProcessor * remove _no_split_modules * fixe error in forward of block and introduce clearer notations * correct converting script with last changes * make style + add draft bark.mdx * correct BarkModelTest::test_generate_text_semantic * add Bark in main README * add dummy_pt_objects for Bark * add missing models in the main init * correct test_decoder_model_past_with_large_inputs * disable torchscript test * change docstring of BarkProcessor * Add test_processor_bark * make style * correct copyrights * add bark.mdx + make style, quality and consistency * Apply suggestions from code review Co-authored-by: Sanchit Gandhi <93869735+sanchit-gandhi@users.noreply.github.com> * Remove unnecessary test method * simply logic of a test * Only check first ids for slow audio generation * split full end-to-end generation tests * remove unneccessary comment * change submodel names for clearer naming * remove ModuleDict from modeling_bark * combine two if statements * ensure that an edge misued won't happen * modify variable name * move code snippet to the right place (coarse instead of semantic) * change BarkSemanticModule -> BarkSemanticModel * align BarkProcessor with transformers paradigm * correct BarkProcessor tests with last commit changes * change _validate_voice_preset to an instance method instead of a class method * tie_weights already called with post_init * add codec_model config to configuration * update bark modeling tests with recent BarkProcessor changes * remove SubModelPretrainedModel + change speakers embeddings prompt type in BarkModel * change absolute imports to relative * remove TODO * change docstrings * add examples to docs and docstrings * make style * uses BatchFeature in BarkProcessor insteads of dict * continue improving docstrings and docs + make style * correct docstrings examples * more comprehensible speaker_embeddings load/Save * rename speaker_embeddings_dict -> speaker_embeddings * correct bark.mdx + add bark to documentation_tests * correct docstrings configuration_bark * integrate last nit suggestions * integrate BarkGeneration configs * make style * remove bark tests from documentation_tests.txt because timeout - tested manually * add proper generation config initialization * small bark.mdx documentation changes * rename bark.mdx -> bark.md * add torch.no_grad behind BarkModel.generate_audio() * replace assert by ValueError in convert_suno_to_hf.py * integrate a series of short comments from reviewer * move SemanticLogitsProcessors and remove .detach() from Bark docs and docstrings * actually remove SemanticLogitsProcessor from modeling_bark.oy * BarkProcessor returns a single output instead of tuple + correct docstrings * make style + correct bug * add initializer_range to BarkConfig + correct slow modeling tests * add .clone() to history_prompt.coarse_prompt to avoid modifying input array * Making sure no extra "`" are present * remove extra characters in modeling_bark.py * Correct output if history_prompt is None * remove TODOs * remove ravel comment * completing generation_configuration_bark.py docstrings * change docstrings - number of audio codebooks instead of Encodec codebooks * change 'bias' docstrings in configuration_bark.py * format code * rename BarkModel.generate_audio -> BarkModel.generate_speech * modify AutoConfig instead of EncodecConfig in BarkConfig * correct AutoConfig wrong init * refactor BarkModel and sub-models generate_coarse, generate_fine, generate_text_semantic * remove SemanticLogitsProcessor and replace it with SuppressTokensLogitsProcessor * move nb_codebook related config arguments to BarkFineConfig * rename bark.mdx -> bark.md * correcting BarkModelConfig from_pretrained + remove keys_to_ignore * correct bark.md with correct hub path * correct code bug in bark.md * correct list tokens_to_suppress * modify Processor to load nested speaker embeddings in a safer way * correct batch sampling in BarkFineModel.generate_fine * Apply suggestions from code review Small docstrings correction and code improvements Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com> * give more details about num_layers in docstrings * correct indentation mistake * correct submodelconfig order of docstring variables * put audio models in alphabetical order in utils/check_repo.my * remove useless line from test_modeling_bark.py * makes BarkCoarseModelTest inherits from (ModelTesterMixin, GenerationTesterMixin, unittest.TestCase) instead of BarkSemanticModelTest * make a Tester class for each sub-model instead of inheriting * add test_resize_embeddings=True for Bark sub-models * add Copied from transformers.models.gpt_neo.modeling_gpt_neo.GPTNeoSelfAttention._split_heads * remove 'Copied fom Bark' comment * remove unneccessary comment * change np.min -> min in modeling_bark.py * refactored all custom layers to have Bark prefix * add attention_mask as an argument of generate_text_semantic * refactor sub-models start docstrings to have more precise config class definition * move _tied_weights_keys overriding * add docstrings to generate_xxx in modeling_bark.py * add loading whole BarkModel to convert_suno_to_hf * refactor attribute and variable names * make style convert_suno * update bark checkpoints * remove never entered if statement * move bark_modeling docstrings after BarkPretrainedModel class definition * refactor modeling_bark.py: kv -> key_values * small nits - code refactoring and removing unecessary lines from _init_weights * nits - replace inplace method by variable assigning * remove *optional* when necessary * remove some lines in generate_speech * add default value for optional parameter * Refactor preprocess_histories_before_coarse -> preprocess_histories Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com> * correct usage after refactoring * refactor Bark's generate_xxx -> generate and modify docstrings and tests accordingly * update docstrings python in configuration_bark.py * add bark files in utils/documentation_test.txt * correct docstrings python snippet * add the ability to use parameters in the form of e.g coarse_temperature * add semantic_max_new_tokens in python snippet in docstrings for quicker generation * Reformate sub-models kwargs in BakModel.generate Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com> * correct kwargs in BarkModel.generate * correct attention_mask kwarg in BarkModel.generate * add tests for sub-models args in BarkModel.generate and correct BarkFineModel.test_generate_fp16 * enrich BarkModel.generate docstrings with a description of how to use the kwargs --------- Co-authored-by: Sanchit Gandhi <93869735+sanchit-gandhi@users.noreply.github.com> Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com> Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
492 lines
28 KiB
Plaintext
492 lines
28 KiB
Plaintext
docs/source/en/autoclass_tutorial.md
|
|
docs/source/en/model_doc/byt5.md
|
|
docs/source/en/model_doc/donut.md
|
|
docs/source/en/model_doc/encoder-decoder.md
|
|
docs/source/en/model_doc/markuplm.md
|
|
docs/source/en/model_doc/speech_to_text.md
|
|
docs/source/en/model_doc/switch_transformers.md
|
|
docs/source/en/model_doc/t5.md
|
|
docs/source/en/model_doc/t5v1.1.md
|
|
docs/source/en/model_doc/tapex.md
|
|
docs/source/en/pipeline_tutorial.md
|
|
docs/source/en/quicktour.md
|
|
docs/source/en/task_summary.md
|
|
docs/source/es/quicktour.md
|
|
src/transformers/generation/configuration_utils.py
|
|
src/transformers/generation/tf_utils.py
|
|
src/transformers/generation/utils.py
|
|
src/transformers/models/albert/configuration_albert.py
|
|
src/transformers/models/albert/modeling_albert.py
|
|
src/transformers/models/albert/modeling_tf_albert.py
|
|
src/transformers/models/albert/tokenization_albert.py
|
|
src/transformers/models/albert/tokenization_albert_fast.py
|
|
src/transformers/models/align/processing_align.py
|
|
src/transformers/models/altclip/processing_altclip.py
|
|
src/transformers/models/audio_spectrogram_transformer/feature_extraction_audio_spectrogram_transformer.py
|
|
src/transformers/models/audio_spectrogram_transformer/modeling_audio_spectrogram_transformer.py
|
|
src/transformers/models/auto/feature_extraction_auto.py
|
|
src/transformers/models/auto/image_processing_auto.py
|
|
src/transformers/models/auto/processing_auto.py
|
|
src/transformers/models/auto/tokenization_auto.py
|
|
src/transformers/models/bark/configuration_bark.py
|
|
src/transformers/models/bark/modeling_bark.py
|
|
src/transformers/models/bark/processing_bark.py
|
|
src/transformers/models/bart/configuration_bart.py
|
|
src/transformers/models/bart/modeling_bart.py
|
|
src/transformers/models/bart/tokenization_bart.py
|
|
src/transformers/models/bart/tokenization_bart_fast.py
|
|
src/transformers/models/barthez/tokenization_barthez.py
|
|
src/transformers/models/barthez/tokenization_barthez_fast.py
|
|
src/transformers/models/bartpho/tokenization_bartpho.py
|
|
src/transformers/models/beit/configuration_beit.py
|
|
src/transformers/models/beit/feature_extraction_beit.py
|
|
src/transformers/models/beit/image_processing_beit.py
|
|
src/transformers/models/beit/modeling_beit.py
|
|
src/transformers/models/bert/configuration_bert.py
|
|
src/transformers/models/bert/modeling_bert.py
|
|
src/transformers/models/bert/modeling_tf_bert.py
|
|
src/transformers/models/bert/tokenization_bert.py
|
|
src/transformers/models/bert/tokenization_bert_fast.py
|
|
src/transformers/models/bert/tokenization_bert_tf.py
|
|
src/transformers/models/bert_generation/configuration_bert_generation.py
|
|
src/transformers/models/bert_generation/tokenization_bert_generation.py
|
|
src/transformers/models/bert_japanese/tokenization_bert_japanese.py
|
|
src/transformers/models/bertweet/tokenization_bertweet.py
|
|
src/transformers/models/big_bird/configuration_big_bird.py
|
|
src/transformers/models/big_bird/modeling_big_bird.py
|
|
src/transformers/models/big_bird/tokenization_big_bird.py
|
|
src/transformers/models/big_bird/tokenization_big_bird_fast.py
|
|
src/transformers/models/bigbird_pegasus/configuration_bigbird_pegasus.py
|
|
src/transformers/models/bigbird_pegasus/modeling_bigbird_pegasus.py
|
|
src/transformers/models/biogpt/tokenization_biogpt.py
|
|
src/transformers/models/bit/image_processing_bit.py
|
|
src/transformers/models/blenderbot/configuration_blenderbot.py
|
|
src/transformers/models/blenderbot/modeling_blenderbot.py
|
|
src/transformers/models/blenderbot/tokenization_blenderbot.py
|
|
src/transformers/models/blenderbot/tokenization_blenderbot_fast.py
|
|
src/transformers/models/blenderbot_small/configuration_blenderbot_small.py
|
|
src/transformers/models/blenderbot_small/modeling_blenderbot_small.py
|
|
src/transformers/models/blenderbot_small/tokenization_blenderbot_small.py
|
|
src/transformers/models/blenderbot_small/tokenization_blenderbot_small_fast.py
|
|
src/transformers/models/blip/image_processing_blip.py
|
|
src/transformers/models/blip/modeling_blip.py
|
|
src/transformers/models/blip/modeling_tf_blip.py
|
|
src/transformers/models/blip/processing_blip.py
|
|
src/transformers/models/blip_2/processing_blip_2.py
|
|
src/transformers/models/bloom/configuration_bloom.py
|
|
src/transformers/models/bloom/tokenization_bloom_fast.py
|
|
src/transformers/models/bridgetower/image_processing_bridgetower.py
|
|
src/transformers/models/bridgetower/processing_bridgetower.py
|
|
src/transformers/models/byt5/tokenization_byt5.py
|
|
src/transformers/models/camembert/configuration_camembert.py
|
|
src/transformers/models/camembert/tokenization_camembert.py
|
|
src/transformers/models/camembert/tokenization_camembert_fast.py
|
|
src/transformers/models/canine/configuration_canine.py
|
|
src/transformers/models/canine/modeling_canine.py
|
|
src/transformers/models/canine/tokenization_canine.py
|
|
src/transformers/models/chinese_clip/feature_extraction_chinese_clip.py
|
|
src/transformers/models/chinese_clip/image_processing_chinese_clip.py
|
|
src/transformers/models/chinese_clip/processing_chinese_clip.py
|
|
src/transformers/models/clap/configuration_clap.py
|
|
src/transformers/models/clap/feature_extraction_clap.py
|
|
src/transformers/models/clap/modeling_clap.py
|
|
src/transformers/models/clap/processing_clap.py
|
|
src/transformers/models/clip/configuration_clip.py
|
|
src/transformers/models/clip/feature_extraction_clip.py
|
|
src/transformers/models/clip/image_processing_clip.py
|
|
src/transformers/models/clip/processing_clip.py
|
|
src/transformers/models/clip/tokenization_clip.py
|
|
src/transformers/models/clip/tokenization_clip_fast.py
|
|
src/transformers/models/clipseg/modeling_clipseg.py
|
|
src/transformers/models/clipseg/processing_clipseg.py
|
|
src/transformers/models/codegen/configuration_codegen.py
|
|
src/transformers/models/codegen/tokenization_codegen.py
|
|
src/transformers/models/codegen/tokenization_codegen_fast.py
|
|
src/transformers/models/conditional_detr/configuration_conditional_detr.py
|
|
src/transformers/models/conditional_detr/feature_extraction_conditional_detr.py
|
|
src/transformers/models/conditional_detr/image_processing_conditional_detr.py
|
|
src/transformers/models/conditional_detr/modeling_conditional_detr.py
|
|
src/transformers/models/convbert/configuration_convbert.py
|
|
src/transformers/models/convbert/tokenization_convbert.py
|
|
src/transformers/models/convbert/tokenization_convbert_fast.py
|
|
src/transformers/models/convnext/configuration_convnext.py
|
|
src/transformers/models/convnext/feature_extraction_convnext.py
|
|
src/transformers/models/convnext/image_processing_convnext.py
|
|
src/transformers/models/convnext/modeling_convnext.py
|
|
src/transformers/models/cpm/tokenization_cpm.py
|
|
src/transformers/models/cpm/tokenization_cpm_fast.py
|
|
src/transformers/models/ctrl/configuration_ctrl.py
|
|
src/transformers/models/ctrl/modeling_ctrl.py
|
|
src/transformers/models/ctrl/tokenization_ctrl.py
|
|
src/transformers/models/cvt/configuration_cvt.py
|
|
src/transformers/models/cvt/modeling_cvt.py
|
|
src/transformers/models/data2vec/configuration_data2vec_audio.py
|
|
src/transformers/models/data2vec/configuration_data2vec_text.py
|
|
src/transformers/models/data2vec/configuration_data2vec_vision.py
|
|
src/transformers/models/data2vec/modeling_data2vec_audio.py
|
|
src/transformers/models/data2vec/modeling_data2vec_vision.py
|
|
src/transformers/models/deberta/configuration_deberta.py
|
|
src/transformers/models/deberta/modeling_deberta.py
|
|
src/transformers/models/deberta/tokenization_deberta.py
|
|
src/transformers/models/deberta/tokenization_deberta_fast.py
|
|
src/transformers/models/deberta_v2/configuration_deberta_v2.py
|
|
src/transformers/models/deberta_v2/modeling_deberta_v2.py
|
|
src/transformers/models/deberta_v2/tokenization_deberta_v2.py
|
|
src/transformers/models/deberta_v2/tokenization_deberta_v2_fast.py
|
|
src/transformers/models/decision_transformer/configuration_decision_transformer.py
|
|
src/transformers/models/deformable_detr/configuration_deformable_detr.py
|
|
src/transformers/models/deformable_detr/feature_extraction_deformable_detr.py
|
|
src/transformers/models/deformable_detr/image_processing_deformable_detr.py
|
|
src/transformers/models/deformable_detr/modeling_deformable_detr.py
|
|
src/transformers/models/deit/configuration_deit.py
|
|
src/transformers/models/deit/feature_extraction_deit.py
|
|
src/transformers/models/deit/image_processing_deit.py
|
|
src/transformers/models/deit/modeling_deit.py
|
|
src/transformers/models/deit/modeling_tf_deit.py
|
|
src/transformers/models/deta/configuration_deta.py
|
|
src/transformers/models/deta/image_processing_deta.py
|
|
src/transformers/models/deta/modeling_deta.py
|
|
src/transformers/models/detr/configuration_detr.py
|
|
src/transformers/models/detr/feature_extraction_detr.py
|
|
src/transformers/models/detr/image_processing_detr.py
|
|
src/transformers/models/detr/modeling_detr.py
|
|
src/transformers/models/dinat/configuration_dinat.py
|
|
src/transformers/models/dinat/modeling_dinat.py
|
|
src/transformers/models/distilbert/configuration_distilbert.py
|
|
src/transformers/models/distilbert/tokenization_distilbert.py
|
|
src/transformers/models/distilbert/tokenization_distilbert_fast.py
|
|
src/transformers/models/donut/feature_extraction_donut.py
|
|
src/transformers/models/donut/image_processing_donut.py
|
|
src/transformers/models/donut/processing_donut.py
|
|
src/transformers/models/dpr/configuration_dpr.py
|
|
src/transformers/models/dpr/tokenization_dpr.py
|
|
src/transformers/models/dpr/tokenization_dpr_fast.py
|
|
src/transformers/models/dpt/feature_extraction_dpt.py
|
|
src/transformers/models/dpt/image_processing_dpt.py
|
|
src/transformers/models/dpt/modeling_dpt.py
|
|
src/transformers/models/efficientformer/image_processing_efficientformer.py
|
|
src/transformers/models/efficientformer/modeling_tf_efficientformer.py
|
|
src/transformers/models/efficientnet/image_processing_efficientnet.py
|
|
src/transformers/models/electra/configuration_electra.py
|
|
src/transformers/models/electra/modeling_electra.py
|
|
src/transformers/models/electra/modeling_tf_electra.py
|
|
src/transformers/models/electra/tokenization_electra.py
|
|
src/transformers/models/electra/tokenization_electra_fast.py
|
|
src/transformers/models/encodec/feature_extraction_encodec.py
|
|
src/transformers/models/encodec/modeling_encodec.py
|
|
src/transformers/models/ernie/configuration_ernie.py
|
|
src/transformers/models/ernie_m/configuration_ernie_m.py
|
|
src/transformers/models/ernie_m/modeling_ernie_m.py
|
|
src/transformers/models/ernie_m/tokenization_ernie_m.py
|
|
src/transformers/models/esm/tokenization_esm.py
|
|
src/transformers/models/flaubert/tokenization_flaubert.py
|
|
src/transformers/models/flava/configuration_flava.py
|
|
src/transformers/models/flava/feature_extraction_flava.py
|
|
src/transformers/models/flava/image_processing_flava.py
|
|
src/transformers/models/flava/processing_flava.py
|
|
src/transformers/models/fnet/configuration_fnet.py
|
|
src/transformers/models/fnet/tokenization_fnet.py
|
|
src/transformers/models/fnet/tokenization_fnet_fast.py
|
|
src/transformers/models/fsmt/configuration_fsmt.py
|
|
src/transformers/models/fsmt/tokenization_fsmt.py
|
|
src/transformers/models/funnel/tokenization_funnel.py
|
|
src/transformers/models/funnel/tokenization_funnel_fast.py
|
|
src/transformers/models/git/modeling_git.py
|
|
src/transformers/models/git/processing_git.py
|
|
src/transformers/models/glpn/feature_extraction_glpn.py
|
|
src/transformers/models/glpn/image_processing_glpn.py
|
|
src/transformers/models/glpn/modeling_glpn.py
|
|
src/transformers/models/gpt2/configuration_gpt2.py
|
|
src/transformers/models/gpt2/modeling_gpt2.py
|
|
src/transformers/models/gpt2/tokenization_gpt2.py
|
|
src/transformers/models/gpt2/tokenization_gpt2_fast.py
|
|
src/transformers/models/gpt2/tokenization_gpt2_tf.py
|
|
src/transformers/models/gpt_neo/configuration_gpt_neo.py
|
|
src/transformers/models/gpt_neox/configuration_gpt_neox.py
|
|
src/transformers/models/gpt_neox/tokenization_gpt_neox_fast.py
|
|
src/transformers/models/gpt_neox_japanese/configuration_gpt_neox_japanese.py
|
|
src/transformers/models/gpt_neox_japanese/tokenization_gpt_neox_japanese.py
|
|
src/transformers/models/gpt_sw3/tokenization_gpt_sw3.py
|
|
src/transformers/models/gptj/modeling_gptj.py
|
|
src/transformers/models/gptsan_japanese/tokenization_gptsan_japanese.py
|
|
src/transformers/models/groupvit/modeling_groupvit.py
|
|
src/transformers/models/groupvit/modeling_tf_groupvit.py
|
|
src/transformers/models/herbert/tokenization_herbert.py
|
|
src/transformers/models/herbert/tokenization_herbert_fast.py
|
|
src/transformers/models/hubert/modeling_hubert.py
|
|
src/transformers/models/imagegpt/configuration_imagegpt.py
|
|
src/transformers/models/imagegpt/feature_extraction_imagegpt.py
|
|
src/transformers/models/imagegpt/image_processing_imagegpt.py
|
|
src/transformers/models/imagegpt/modeling_imagegpt.py
|
|
src/transformers/models/jukebox/tokenization_jukebox.py
|
|
src/transformers/models/jukebox/tokenization_jukebox.py
|
|
src/transformers/models/layoutlm/configuration_layoutlm.py
|
|
src/transformers/models/layoutlm/modeling_layoutlm.py
|
|
src/transformers/models/layoutlm/modeling_tf_layoutlm.py
|
|
src/transformers/models/layoutlm/tokenization_layoutlm.py
|
|
src/transformers/models/layoutlm/tokenization_layoutlm_fast.py
|
|
src/transformers/models/layoutlmv2/configuration_layoutlmv2.py
|
|
src/transformers/models/layoutlmv2/feature_extraction_layoutlmv2.py
|
|
src/transformers/models/layoutlmv2/image_processing_layoutlmv2.py
|
|
src/transformers/models/layoutlmv2/modeling_layoutlmv2.py
|
|
src/transformers/models/layoutlmv2/processing_layoutlmv2.py
|
|
src/transformers/models/layoutlmv2/tokenization_layoutlmv2.py
|
|
src/transformers/models/layoutlmv2/tokenization_layoutlmv2_fast.py
|
|
src/transformers/models/layoutlmv3/configuration_layoutlmv3.py
|
|
src/transformers/models/layoutlmv3/feature_extraction_layoutlmv3.py
|
|
src/transformers/models/layoutlmv3/image_processing_layoutlmv3.py
|
|
src/transformers/models/layoutlmv3/modeling_layoutlmv3.py
|
|
src/transformers/models/layoutlmv3/modeling_tf_layoutlmv3.py
|
|
src/transformers/models/layoutlmv3/processing_layoutlmv3.py
|
|
src/transformers/models/layoutlmv3/tokenization_layoutlmv3.py
|
|
src/transformers/models/layoutlmv3/tokenization_layoutlmv3_fast.py
|
|
src/transformers/models/layoutxlm/processing_layoutxlm.py
|
|
src/transformers/models/layoutxlm/tokenization_layoutxlm.py
|
|
src/transformers/models/layoutxlm/tokenization_layoutxlm_fast.py
|
|
src/transformers/models/led/tokenization_led.py
|
|
src/transformers/models/led/tokenization_led_fast.py
|
|
src/transformers/models/levit/configuration_levit.py
|
|
src/transformers/models/levit/feature_extraction_levit.py
|
|
src/transformers/models/levit/image_processing_levit.py
|
|
src/transformers/models/lilt/modeling_lilt.py
|
|
src/transformers/models/llama/tokenization_llama.py
|
|
src/transformers/models/longformer/modeling_longformer.py
|
|
src/transformers/models/longformer/modeling_tf_longformer.py
|
|
src/transformers/models/longformer/tokenization_longformer.py
|
|
src/transformers/models/longformer/tokenization_longformer_fast.py
|
|
src/transformers/models/longt5/modeling_longt5.py
|
|
src/transformers/models/luke/tokenization_luke.py
|
|
src/transformers/models/lxmert/tokenization_lxmert.py
|
|
src/transformers/models/lxmert/tokenization_lxmert_fast.py
|
|
src/transformers/models/m2m_100/configuration_m2m_100.py
|
|
src/transformers/models/m2m_100/tokenization_m2m_100.py
|
|
src/transformers/models/marian/modeling_marian.py
|
|
src/transformers/models/marian/tokenization_marian.py
|
|
src/transformers/models/markuplm/modeling_markuplm.py
|
|
src/transformers/models/markuplm/processing_markuplm.py
|
|
src/transformers/models/markuplm/tokenization_markuplm.py
|
|
src/transformers/models/markuplm/tokenization_markuplm_fast.py
|
|
src/transformers/models/mask2former/configuration_mask2former.py
|
|
src/transformers/models/mask2former/image_processing_mask2former.py
|
|
src/transformers/models/mask2former/modeling_mask2former.py
|
|
src/transformers/models/maskformer/configuration_maskformer.py
|
|
src/transformers/models/maskformer/feature_extraction_maskformer.py
|
|
src/transformers/models/maskformer/image_processing_maskformer.py
|
|
src/transformers/models/maskformer/modeling_maskformer.py
|
|
src/transformers/models/mbart/configuration_mbart.py
|
|
src/transformers/models/mbart/modeling_mbart.py
|
|
src/transformers/models/mbart/modeling_tf_mbart.py
|
|
src/transformers/models/mbart/tokenization_mbart.py
|
|
src/transformers/models/mbart/tokenization_mbart_fast.py
|
|
src/transformers/models/mbart50/tokenization_mbart50.py
|
|
src/transformers/models/mbart50/tokenization_mbart50_fast.py
|
|
src/transformers/models/megatron_bert/configuration_megatron_bert.py
|
|
src/transformers/models/mgp_str/processing_mgp_str.py
|
|
src/transformers/models/mgp_str/tokenization_mgp_str.py
|
|
src/transformers/models/mluke/tokenization_mluke.py
|
|
src/transformers/models/mobilebert/configuration_mobilebert.py
|
|
src/transformers/models/mobilebert/modeling_mobilebert.py
|
|
src/transformers/models/mobilebert/modeling_tf_mobilebert.py
|
|
src/transformers/models/mobilebert/tokenization_mobilebert.py
|
|
src/transformers/models/mobilebert/tokenization_mobilebert_fast.py
|
|
src/transformers/models/mobilenet_v1/feature_extraction_mobilenet_v1.py
|
|
src/transformers/models/mobilenet_v1/image_processing_mobilenet_v1.py
|
|
src/transformers/models/mobilenet_v1/modeling_mobilenet_v1.py
|
|
src/transformers/models/mobilenet_v2/feature_extraction_mobilenet_v2.py
|
|
src/transformers/models/mobilenet_v2/image_processing_mobilenet_v2.py
|
|
src/transformers/models/mobilenet_v2/modeling_mobilenet_v2.py
|
|
src/transformers/models/mobilevit/feature_extraction_mobilevit.py
|
|
src/transformers/models/mobilevit/image_processing_mobilevit.py
|
|
src/transformers/models/mobilevit/modeling_mobilevit.py
|
|
src/transformers/models/mobilevit/modeling_tf_mobilevit.py
|
|
src/transformers/models/mobilevitv2/configuration_mobilevitv2.py
|
|
src/transformers/models/mobilevitv2/modeling_mobilevitv2.py
|
|
src/transformers/models/mpnet/tokenization_mpnet.py
|
|
src/transformers/models/mpnet/tokenization_mpnet_fast.py
|
|
src/transformers/models/musicgen/configuration_musicgen.py
|
|
src/transformers/models/musicgen/modeling_musicgen.py
|
|
src/transformers/models/musicgen/processing_musicgen.py
|
|
src/transformers/models/mvp/configuration_mvp.py
|
|
src/transformers/models/mvp/tokenization_mvp.py
|
|
src/transformers/models/mvp/tokenization_mvp_fast.py
|
|
src/transformers/models/nat/configuration_nat.py
|
|
src/transformers/models/nat/modeling_nat.py
|
|
src/transformers/models/nezha/configuration_nezha.py
|
|
src/transformers/models/nllb/tokenization_nllb.py
|
|
src/transformers/models/nllb/tokenization_nllb_fast.py
|
|
src/transformers/models/oneformer/configuration_oneformer.py
|
|
src/transformers/models/oneformer/image_processing_oneformer.py
|
|
src/transformers/models/oneformer/modeling_oneformer.py
|
|
src/transformers/models/oneformer/processing_oneformer.py
|
|
src/transformers/models/openai/configuration_openai.py
|
|
src/transformers/models/openai/tokenization_openai.py
|
|
src/transformers/models/openai/tokenization_openai_fast.py
|
|
src/transformers/models/opt/configuration_opt.py
|
|
src/transformers/models/opt/modeling_opt.py
|
|
src/transformers/models/opt/modeling_tf_opt.py
|
|
src/transformers/models/owlvit/feature_extraction_owlvit.py
|
|
src/transformers/models/owlvit/image_processing_owlvit.py
|
|
src/transformers/models/owlvit/modeling_owlvit.py
|
|
src/transformers/models/owlvit/processing_owlvit.py
|
|
src/transformers/models/pegasus/configuration_pegasus.py
|
|
src/transformers/models/pegasus/modeling_pegasus.py
|
|
src/transformers/models/pegasus/tokenization_pegasus.py
|
|
src/transformers/models/pegasus/tokenization_pegasus_fast.py
|
|
src/transformers/models/pegasus_x/configuration_pegasus_x.py
|
|
src/transformers/models/perceiver/feature_extraction_perceiver.py
|
|
src/transformers/models/perceiver/image_processing_perceiver.py
|
|
src/transformers/models/perceiver/modeling_perceiver.py
|
|
src/transformers/models/perceiver/tokenization_perceiver.py
|
|
src/transformers/models/phobert/tokenization_phobert.py
|
|
src/transformers/models/pix2struct/modeling_pix2struct.py
|
|
src/transformers/models/plbart/configuration_plbart.py
|
|
src/transformers/models/plbart/modeling_plbart.py
|
|
src/transformers/models/plbart/tokenization_plbart.py
|
|
src/transformers/models/poolformer/configuration_poolformer.py
|
|
src/transformers/models/poolformer/feature_extraction_poolformer.py
|
|
src/transformers/models/poolformer/image_processing_poolformer.py
|
|
src/transformers/models/poolformer/modeling_poolformer.py
|
|
src/transformers/models/prophetnet/tokenization_prophetnet.py
|
|
src/transformers/models/rag/tokenization_rag.py
|
|
src/transformers/models/realm/configuration_realm.py
|
|
src/transformers/models/realm/tokenization_realm.py
|
|
src/transformers/models/realm/tokenization_realm_fast.py
|
|
src/transformers/models/reformer/configuration_reformer.py
|
|
src/transformers/models/reformer/modeling_reformer.py
|
|
src/transformers/models/reformer/tokenization_reformer.py
|
|
src/transformers/models/reformer/tokenization_reformer_fast.py
|
|
src/transformers/models/regnet/modeling_regnet.py
|
|
src/transformers/models/regnet/modeling_tf_regnet.py
|
|
src/transformers/models/rembert/tokenization_rembert.py
|
|
src/transformers/models/rembert/tokenization_rembert_fast.py
|
|
src/transformers/models/resnet/configuration_resnet.py
|
|
src/transformers/models/resnet/modeling_resnet.py
|
|
src/transformers/models/resnet/modeling_tf_resnet.py
|
|
src/transformers/models/roberta/configuration_roberta.py
|
|
src/transformers/models/roberta/modeling_roberta.py
|
|
src/transformers/models/roberta/modeling_tf_roberta.py
|
|
src/transformers/models/roberta/tokenization_roberta.py
|
|
src/transformers/models/roberta/tokenization_roberta_fast.py
|
|
src/transformers/models/roberta_prelayernorm/configuration_roberta_prelayernorm.py
|
|
src/transformers/models/roberta_prelayernorm/modeling_roberta_prelayernorm.py
|
|
src/transformers/models/roberta_prelayernorm/modeling_tf_roberta_prelayernorm.py
|
|
src/transformers/models/roc_bert/modeling_roc_bert.py
|
|
src/transformers/models/roc_bert/tokenization_roc_bert.py
|
|
src/transformers/models/roformer/tokenization_roformer.py
|
|
src/transformers/models/roformer/tokenization_roformer_fast.py
|
|
src/transformers/models/roformer/tokenization_utils.py
|
|
src/transformers/models/segformer/feature_extraction_segformer.py
|
|
src/transformers/models/segformer/image_processing_segformer.py
|
|
src/transformers/models/segformer/modeling_segformer.py
|
|
src/transformers/models/segformer/modeling_tf_segformer.py
|
|
src/transformers/models/sew/configuration_sew.py
|
|
src/transformers/models/sew/modeling_sew.py
|
|
src/transformers/models/sew_d/configuration_sew_d.py
|
|
src/transformers/models/sew_d/modeling_sew_d.py
|
|
src/transformers/models/speech_encoder_decoder/modeling_speech_encoder_decoder.py
|
|
src/transformers/models/speech_to_text/configuration_speech_to_text.py
|
|
src/transformers/models/speech_to_text/feature_extraction_speech_to_text.py
|
|
src/transformers/models/speech_to_text/modeling_speech_to_text.py
|
|
src/transformers/models/speech_to_text/processing_speech_to_text.py
|
|
src/transformers/models/speech_to_text/tokenization_speech_to_text.py
|
|
src/transformers/models/speech_to_text_2/configuration_speech_to_text_2.py
|
|
src/transformers/models/speech_to_text_2/modeling_speech_to_text_2.py
|
|
src/transformers/models/speech_to_text_2/processing_speech_to_text_2.py
|
|
src/transformers/models/speech_to_text_2/tokenization_speech_to_text_2.py
|
|
src/transformers/models/speecht5/feature_extraction_speecht5.py
|
|
src/transformers/models/speecht5/modeling_speecht5.py
|
|
src/transformers/models/speecht5/processing_speecht5.py
|
|
src/transformers/models/speecht5/tokenization_speecht5.py
|
|
src/transformers/models/splinter/tokenization_splinter.py
|
|
src/transformers/models/splinter/tokenization_splinter_fast.py
|
|
src/transformers/models/squeezebert/configuration_squeezebert.py
|
|
src/transformers/models/squeezebert/tokenization_squeezebert.py
|
|
src/transformers/models/squeezebert/tokenization_squeezebert_fast.py
|
|
src/transformers/models/swin/configuration_swin.py
|
|
src/transformers/models/swin/modeling_swin.py
|
|
src/transformers/models/swin2sr/image_processing_swin2sr.py
|
|
src/transformers/models/swin2sr/modeling_swin2sr.py
|
|
src/transformers/models/swinv2/configuration_swinv2.py
|
|
src/transformers/models/t5/tokenization_t5.py
|
|
src/transformers/models/t5/tokenization_t5_fast.py
|
|
src/transformers/models/table_transformer/modeling_table_transformer.py
|
|
src/transformers/models/tapas/tokenization_tapas.py
|
|
src/transformers/models/time_series_transformer/configuration_time_series_transformer.py
|
|
src/transformers/models/time_series_transformer/modeling_time_series_transformer.py
|
|
src/transformers/models/timesformer/configuration_timesformer.py
|
|
src/transformers/models/timesformer/modeling_timesformer.py
|
|
src/transformers/models/transfo_xl/configuration_transfo_xl.py
|
|
src/transformers/models/transfo_xl/tokenization_transfo_xl.py
|
|
src/transformers/models/trocr/configuration_trocr.py
|
|
src/transformers/models/trocr/modeling_trocr.py
|
|
src/transformers/models/trocr/processing_trocr.py
|
|
src/transformers/models/tvlt/feature_extraction_tvlt.py
|
|
src/transformers/models/tvlt/image_processing_tvlt.py
|
|
src/transformers/models/tvlt/processing_tvlt.py
|
|
src/transformers/models/unispeech/configuration_unispeech.py
|
|
src/transformers/models/unispeech/modeling_unispeech.py
|
|
src/transformers/models/unispeech_sat/modeling_unispeech_sat.py
|
|
src/transformers/models/upernet/modeling_upernet.py
|
|
src/transformers/models/videomae/feature_extraction_videomae.py
|
|
src/transformers/models/videomae/image_processing_videomae.py
|
|
src/transformers/models/videomae/modeling_videomae.py
|
|
src/transformers/models/vilt/feature_extraction_vilt.py
|
|
src/transformers/models/vilt/image_processing_vilt.py
|
|
src/transformers/models/vilt/modeling_vilt.py
|
|
src/transformers/models/vilt/processing_vilt.py
|
|
src/transformers/models/vision_encoder_decoder/configuration_vision_encoder_decoder.py
|
|
src/transformers/models/vision_encoder_decoder/modeling_vision_encoder_decoder.py
|
|
src/transformers/models/vision_text_dual_encoder/configuration_vision_text_dual_encoder.py
|
|
src/transformers/models/vision_text_dual_encoder/modeling_tf_vision_text_dual_encoder.py
|
|
src/transformers/models/vision_text_dual_encoder/processing_vision_text_dual_encoder.py
|
|
src/transformers/models/visual_bert/configuration_visual_bert.py
|
|
src/transformers/models/vit/configuration_vit.py
|
|
src/transformers/models/vit/feature_extraction_vit.py
|
|
src/transformers/models/vit/image_processing_vit.py
|
|
src/transformers/models/vit/modeling_tf_vit.py
|
|
src/transformers/models/vit/modeling_vit.py
|
|
src/transformers/models/vit_hybrid/image_processing_vit_hybrid.py
|
|
src/transformers/models/vit_mae/configuration_vit_mae.py
|
|
src/transformers/models/vit_mae/modeling_vit_mae.py
|
|
src/transformers/models/vit_msn/modeling_vit_msn.py
|
|
src/transformers/models/wav2vec2/configuration_wav2vec2.py
|
|
src/transformers/models/wav2vec2/feature_extraction_wav2vec2.py
|
|
src/transformers/models/wav2vec2/modeling_wav2vec2.py
|
|
src/transformers/models/wav2vec2/processing_wav2vec2.py
|
|
src/transformers/models/wav2vec2/tokenization_wav2vec2.py
|
|
src/transformers/models/wav2vec2_conformer/configuration_wav2vec2_conformer.py
|
|
src/transformers/models/wav2vec2_conformer/modeling_wav2vec2_conformer.py
|
|
src/transformers/models/wav2vec2_phoneme/tokenization_wav2vec2_phoneme.py
|
|
src/transformers/models/wav2vec2_with_lm/processing_wav2vec2_with_lm.py
|
|
src/transformers/models/wavlm/configuration_wavlm.py
|
|
src/transformers/models/wavlm/modeling_wavlm.py
|
|
src/transformers/models/whisper/configuration_whisper.py
|
|
src/transformers/models/whisper/feature_extraction_whisper.py
|
|
src/transformers/models/whisper/modeling_tf_whisper.py
|
|
src/transformers/models/whisper/modeling_whisper.py
|
|
src/transformers/models/whisper/processing_whisper.py
|
|
src/transformers/models/whisper/tokenization_whisper.py
|
|
src/transformers/models/whisper/tokenization_whisper_fast.py
|
|
src/transformers/models/x_clip/modeling_x_clip.py
|
|
src/transformers/models/x_clip/processing_x_clip.py
|
|
src/transformers/models/xglm/tokenization_xglm.py
|
|
src/transformers/models/xglm/tokenization_xglm_fast.py
|
|
src/transformers/models/xlm/configuration_xlm.py
|
|
src/transformers/models/xlm/tokenization_xlm.py
|
|
src/transformers/models/xlm_prophetnet/tokenization_xlm_prophetnet.py
|
|
src/transformers/models/xlm_roberta/configuration_xlm_roberta.py
|
|
src/transformers/models/xlm_roberta/tokenization_xlm_roberta.py
|
|
src/transformers/models/xlm_roberta/tokenization_xlm_roberta_fast.py
|
|
src/transformers/models/xlm_roberta_xl/configuration_xlm_roberta_xl.py
|
|
src/transformers/models/xlnet/configuration_xlnet.py
|
|
src/transformers/models/xlnet/tokenization_xlnet.py
|
|
src/transformers/models/xlnet/tokenization_xlnet_fast.py
|
|
src/transformers/models/xmod/configuration_xmod.py
|
|
src/transformers/models/xmod/modeling_xmod.py
|
|
src/transformers/models/yolos/configuration_yolos.py
|
|
src/transformers/models/yolos/feature_extraction_yolos.py
|
|
src/transformers/models/yolos/image_processing_yolos.py
|
|
src/transformers/models/yolos/modeling_yolos.py
|
|
src/transformers/models/yoso/configuration_yoso.py
|
|
src/transformers/pipelines/
|