mirror of
https://github.com/huggingface/transformers.git
synced 2025-07-15 10:38:23 +06:00
e5a9ce48f7
* init * chore: various changes to LightGlue * chore: various changes to LightGlue * chore: various changes to LightGlue * chore: various changes to LightGlue * Fixed dynamo bug and image padding tests * refactor: applied refactoring changes from SuperGlue's concat, batch and stack functions to LightGlue file * tests: removed sdpa support and changed expected values * chore: added some docs and refactoring * chore: fixed copy to superpoint.image_processing_superpoint.convert_to_grayscale * feat: adding batch implementation * feat: added validation for preprocess and post process method to LightGlueImageProcessor * chore: changed convert_lightglue_to_hf script to comply with new standard * chore: changed lightglue test values to match new lightglue config pushed to hub * chore: simplified convert_lightglue_to_hf conversion map * feat: adding batching implementation * chore: make style * feat: added threshold to post_process_keypoint_matching method * fix: added missing instructions that turns keypoints back to absolute coordinate before matching forward * fix: added typehint and docs * chore: make style * [run-slow] lightglue * fix: add matches different from -1 to compute valid matches in post_process_keypoint_matching * tests: added CUDA proof tests similar to SuperGlue * chore: various changes to modeling_lightglue.py - Added "Copies from" statements for copied functions from modeling_superglue.py - Added missing docstrings - Removed unused functions or classes - Removed unnecessary statements - Added missing typehints - Added comments to the main forward method * chore: various changes to convert_lightglue_to_hf.py - Added model saving - Added model reloading * chore: fixed imports in lightglue files * [run-slow] lightglue * chore: make style * [run-slow] lightglue * Apply suggestions from code review Co-authored-by: Pavel Iakubovskii <qubvel@gmail.com> * [run-slow] lightglue * chore: Applied some suggestions from review - Added missing typehints - Refactor "cuda" to device variable - Variable renaming - LightGlue output order changed - Make style * fix: added missing grayscale argument in image processor in case use of SuperPoint keypoint detector * fix: changed lightglue HF repo to lightglue_superpoint with grayscale default to True * refactor: make keypoints `(batch_size, num_keypoints, keypoint_dim)` through forward and unsqueeze only before attention layer * refactor: refactor do_layer_keypoint_pruning * tests: added tests with no early stop and keypoint pruning * refactor: various refactoring to modeling_lightglue.py - Removed unused functions - Renamed variables for consistency - Added comments for clarity - Set methods to private in LightGlueForKeypointMatching - Replaced tensor initialization to list then concatenation - Used more pythonic list comprehension for repetitive instructions * refactor: added comments and renamed filter_matches to get_matches_from_scores * tests: added copied from statement with superglue tests * docs: added comment to prepare_keypoint_matching_output function in tests * [run-slow] lightglue * refactor: reordered _concat_early_stopped_outputs in LightGlue class * [run-slow] lightglue * docs: added lightglue.md model doc * docs: added Optional typehint to LightGlueKeypointMatchingOutput * chore: removed pad_images function * chore: set do_grayscale default value to True in LightGlueImageProcessor * Apply suggestions from code review Co-authored-by: Pavel Iakubovskii <qubvel@gmail.com> * Apply suggestions from code review Co-authored-by: Pavel Iakubovskii <qubvel@gmail.com> * docs: added missing LightGlueConfig typehint in nn.Module __init__ methods * docs: removed unnecessary code in docs * docs: import SuperPointConfig only from a TYPE_CHECKING context * chore: use PretrainedConfig arguments `num_hidden_layers` and `num_attention_heads` instead of `num_layers` and `num_heads` * chore: added organization as arg in convert_lightglue_to_hf.py script * refactor: set device variable * chore: added "gelu" in LightGlueConfig as hidden_act parameter * docs: added comments to reshape.flip.reshape instruction to perform cross attention * refactor: used batched inference for keypoint detector forward pass * fix: added fix for SDPA tests * docs: fixed docstring for LightGlueImageProcessor * [run-slow] lightglue * refactor: removed unused line * refactor: added missing arguments in LightGlueConfig init method * docs: added missing LightGlueConfig typehint in init methods * refactor: added checkpoint url as default variable to verify models output only if it is the default url * fix: moved print message inside if statement * fix: added log assignment r removal in convert script * fix: got rid of confidence_thresholds as registered buffers * refactor: applied suggestions from SuperGlue PR * docs: changed copyright to 2025 * refactor: modular LightGlue * fix: removed unnecessary import * feat: added plot_keypoint_matching method to LightGlueImageProcessor with matplotlib soft dependency * fix: added missing import error for matplotlib * Updated convert script to push on ETH org * fix: added missing licence * fix: make fix-copies * refactor: use cohere apply_rotary_pos_emb function * fix: update model references to use ETH-CVG/lightglue_superpoint * refactor: add and use intermediate_size attribute in config to inherit CLIPMLP for LightGlueMLP * refactor: explicit variables instead of slicing * refactor: use can_return_tuple decorator in LightGlue model * fix: make fix-copies * docs: Update model references in `lightglue.md` to use the correct pretrained model from ETH-CVG * Refactor LightGlue configuration and processing classes - Updated type hints for `keypoint_detector_config` in `LightGlueConfig` to use `SuperPointConfig` directly. - Changed `size` parameter in `LightGlueImageProcessor` to be optional. - Modified `position_embeddings` in `LightGlueAttention` and `LightGlueAttentionBlock` to be optional tuples. - Cleaned up import statements across multiple files for better readability and consistency. * refactor: Update LightGlue configuration to enforce eager attention implementation - Added `attn_implementation="eager"` to `keypoint_detector_config` in `LightGlueConfig` and `LightGlueAttention` classes. - Removed unnecessary logging related to attention implementation fallback. - Cleaned up import statements for better readability. * refactor: renamed message into attention_output * fix: ensure device compatibility in LightGlueMatchAssignmentLayer descriptor normalization - Updated the normalization of `m_descriptors` to use the correct device for the tensor, ensuring compatibility across different hardware setups. * refactor: removed Conv layers from init_weights since LightGlue doesn't have any * refactor: replace add_start_docstrings with auto_docstring in LightGlue models - Updated LightGlue model classes to utilize the new auto_docstring utility for automatic documentation generation. - Removed legacy docstring handling to streamline the code and improve maintainability. * refactor: simplify LightGlue image processing tests by inheriting from SuperGlue - Refactored `LightGlueImageProcessingTester` and `LightGlueImageProcessingTest` to inherit from their SuperGlue counterparts, reducing code duplication. - Removed redundant methods and properties, streamlining the test setup and improving maintainability. * test: forced eager attention implementation to LightGlue model tests - Updated `LightGlueModelTester` to include `attn_implementation="eager"` in the model configuration. - This change aligns the test setup with the recent updates in LightGlue configuration for eager attention. * refactor: update LightGlue model references * fix: import error * test: enhance LightGlue image processing tests with setup method - Added a setup method in `LightGlueImageProcessingTest` to initialize `LightGlueImageProcessingTester`. - Included a docstring for `LightGlueImageProcessingTester` to clarify its purpose. * refactor: added LightGlue image processing implementation to modular file * refactor: moved attention blocks into the transformer layer * fix: added missing import * fix: added missing import in __all__ variable * doc: added comment about enforcing eager attention because of SuperPoint * refactor: added SuperPoint eager attention comment and moved functions to the closest they are used --------- Co-authored-by: Steven Bucaille <steven.bucaille@buawei.com> Co-authored-by: Pavel Iakubovskii <qubvel@gmail.com> |
||
|---|---|---|
| .. | ||
| albert.md | ||
| align.md | ||
| altclip.md | ||
| aria.md | ||
| audio-spectrogram-transformer.md | ||
| auto.md | ||
| autoformer.md | ||
| aya_vision.md | ||
| bamba.md | ||
| bark.md | ||
| bart.md | ||
| barthez.md | ||
| bartpho.md | ||
| beit.md | ||
| bert-generation.md | ||
| bert-japanese.md | ||
| bert.md | ||
| bertweet.md | ||
| big_bird.md | ||
| bigbird_pegasus.md | ||
| biogpt.md | ||
| bit.md | ||
| bitnet.md | ||
| blenderbot-small.md | ||
| blenderbot.md | ||
| blip-2.md | ||
| blip.md | ||
| bloom.md | ||
| bort.md | ||
| bridgetower.md | ||
| bros.md | ||
| byt5.md | ||
| camembert.md | ||
| canine.md | ||
| chameleon.md | ||
| chinese_clip.md | ||
| clap.md | ||
| clip.md | ||
| clipseg.md | ||
| clvp.md | ||
| code_llama.md | ||
| codegen.md | ||
| cohere.md | ||
| cohere2.md | ||
| colpali.md | ||
| colqwen2.md | ||
| conditional_detr.md | ||
| convbert.md | ||
| convnext.md | ||
| convnextv2.md | ||
| cpm.md | ||
| cpmant.md | ||
| csm.md | ||
| ctrl.md | ||
| cvt.md | ||
| d_fine.md | ||
| dab-detr.md | ||
| dac.md | ||
| data2vec.md | ||
| dbrx.md | ||
| deberta-v2.md | ||
| deberta.md | ||
| decision_transformer.md | ||
| deepseek_v3.md | ||
| deformable_detr.md | ||
| deit.md | ||
| deplot.md | ||
| depth_anything_v2.md | ||
| depth_anything.md | ||
| depth_pro.md | ||
| deta.md | ||
| detr.md | ||
| dialogpt.md | ||
| diffllama.md | ||
| dinat.md | ||
| dinov2_with_registers.md | ||
| dinov2.md | ||
| distilbert.md | ||
| dit.md | ||
| donut.md | ||
| dpr.md | ||
| dpt.md | ||
| efficientformer.md | ||
| efficientnet.md | ||
| electra.md | ||
| emu3.md | ||
| encodec.md | ||
| encoder-decoder.md | ||
| ernie_m.md | ||
| ernie.md | ||
| esm.md | ||
| falcon_h1.md | ||
| falcon_mamba.md | ||
| falcon.md | ||
| falcon3.md | ||
| fastspeech2_conformer.md | ||
| flan-t5.md | ||
| flan-ul2.md | ||
| flaubert.md | ||
| flava.md | ||
| fnet.md | ||
| focalnet.md | ||
| fsmt.md | ||
| funnel.md | ||
| fuyu.md | ||
| gemma.md | ||
| gemma2.md | ||
| gemma3.md | ||
| git.md | ||
| glm.md | ||
| glm4.md | ||
| glpn.md | ||
| got_ocr2.md | ||
| gpt_bigcode.md | ||
| gpt_neo.md | ||
| gpt_neox_japanese.md | ||
| gpt_neox.md | ||
| gpt-sw3.md | ||
| gpt2.md | ||
| gptj.md | ||
| gptsan-japanese.md | ||
| granite_speech.md | ||
| granite.md | ||
| granitemoe.md | ||
| granitemoehybrid.md | ||
| granitemoeshared.md | ||
| granitevision.md | ||
| graphormer.md | ||
| grounding-dino.md | ||
| groupvit.md | ||
| helium.md | ||
| herbert.md | ||
| hgnet_v2.md | ||
| hiera.md | ||
| hubert.md | ||
| ibert.md | ||
| idefics.md | ||
| idefics2.md | ||
| idefics3.md | ||
| ijepa.md | ||
| imagegpt.md | ||
| informer.md | ||
| instructblip.md | ||
| instructblipvideo.md | ||
| internvl.md | ||
| jamba.md | ||
| janus.md | ||
| jetmoe.md | ||
| jukebox.md | ||
| kosmos-2.md | ||
| layoutlm.md | ||
| layoutlmv2.md | ||
| layoutlmv3.md | ||
| layoutxlm.md | ||
| led.md | ||
| levit.md | ||
| lightglue.md | ||
| lilt.md | ||
| llama.md | ||
| llama2.md | ||
| llama3.md | ||
| llama4.md | ||
| llava_next_video.md | ||
| llava_next.md | ||
| llava_onevision.md | ||
| llava.md | ||
| longformer.md | ||
| longt5.md | ||
| luke.md | ||
| lxmert.md | ||
| m2m_100.md | ||
| madlad-400.md | ||
| mamba.md | ||
| mamba2.md | ||
| marian.md | ||
| markuplm.md | ||
| mask2former.md | ||
| maskformer.md | ||
| matcha.md | ||
| mbart.md | ||
| mctct.md | ||
| mega.md | ||
| megatron_gpt2.md | ||
| megatron-bert.md | ||
| mgp-str.md | ||
| mimi.md | ||
| minimax.md | ||
| mistral.md | ||
| mistral3.md | ||
| mixtral.md | ||
| mlcd.md | ||
| mllama.md | ||
| mluke.md | ||
| mms.md | ||
| mobilebert.md | ||
| mobilenet_v1.md | ||
| mobilenet_v2.md | ||
| mobilevit.md | ||
| mobilevitv2.md | ||
| modernbert.md | ||
| moonshine.md | ||
| moshi.md | ||
| mpnet.md | ||
| mpt.md | ||
| mra.md | ||
| mt5.md | ||
| musicgen_melody.md | ||
| musicgen.md | ||
| mvp.md | ||
| myt5.md | ||
| nat.md | ||
| nemotron.md | ||
| nezha.md | ||
| nllb-moe.md | ||
| nllb.md | ||
| nougat.md | ||
| nystromformer.md | ||
| olmo.md | ||
| olmo2.md | ||
| olmoe.md | ||
| omdet-turbo.md | ||
| oneformer.md | ||
| open-llama.md | ||
| openai-gpt.md | ||
| opt.md | ||
| owlv2.md | ||
| owlvit.md | ||
| paligemma.md | ||
| patchtsmixer.md | ||
| patchtst.md | ||
| pegasus_x.md | ||
| pegasus.md | ||
| perceiver.md | ||
| persimmon.md | ||
| phi.md | ||
| phi3.md | ||
| phi4_multimodal.md | ||
| phimoe.md | ||
| phobert.md | ||
| pix2struct.md | ||
| pixtral.md | ||
| plbart.md | ||
| poolformer.md | ||
| pop2piano.md | ||
| prompt_depth_anything.md | ||
| prophetnet.md | ||
| pvt_v2.md | ||
| pvt.md | ||
| qdqbert.md | ||
| qwen2_5_omni.md | ||
| qwen2_5_vl.md | ||
| qwen2_audio.md | ||
| qwen2_moe.md | ||
| qwen2_vl.md | ||
| qwen2.md | ||
| qwen3_moe.md | ||
| qwen3.md | ||
| rag.md | ||
| realm.md | ||
| recurrent_gemma.md | ||
| reformer.md | ||
| regnet.md | ||
| rembert.md | ||
| resnet.md | ||
| retribert.md | ||
| roberta-prelayernorm.md | ||
| roberta.md | ||
| roc_bert.md | ||
| roformer.md | ||
| rt_detr_v2.md | ||
| rt_detr.md | ||
| rwkv.md | ||
| sam_hq.md | ||
| sam.md | ||
| seamless_m4t_v2.md | ||
| seamless_m4t.md | ||
| segformer.md | ||
| seggpt.md | ||
| sew-d.md | ||
| sew.md | ||
| shieldgemma2.md | ||
| siglip.md | ||
| siglip2.md | ||
| smolvlm.md | ||
| speech_to_text_2.md | ||
| speech_to_text.md | ||
| speech-encoder-decoder.md | ||
| speecht5.md | ||
| splinter.md | ||
| squeezebert.md | ||
| stablelm.md | ||
| starcoder2.md | ||
| superglue.md | ||
| superpoint.md | ||
| swiftformer.md | ||
| swin.md | ||
| swin2sr.md | ||
| swinv2.md | ||
| switch_transformers.md | ||
| t5.md | ||
| t5v1.1.md | ||
| table-transformer.md | ||
| tapas.md | ||
| tapex.md | ||
| textnet.md | ||
| time_series_transformer.md | ||
| timesfm.md | ||
| timesformer.md | ||
| timm_wrapper.md | ||
| trajectory_transformer.md | ||
| transfo-xl.md | ||
| trocr.md | ||
| tvlt.md | ||
| tvp.md | ||
| udop.md | ||
| ul2.md | ||
| umt5.md | ||
| unispeech-sat.md | ||
| unispeech.md | ||
| univnet.md | ||
| upernet.md | ||
| van.md | ||
| video_llava.md | ||
| videomae.md | ||
| vilt.md | ||
| vipllava.md | ||
| vision-encoder-decoder.md | ||
| vision-text-dual-encoder.md | ||
| visual_bert.md | ||
| vit_hybrid.md | ||
| vit_mae.md | ||
| vit_msn.md | ||
| vit.md | ||
| vitdet.md | ||
| vitmatte.md | ||
| vitpose.md | ||
| vits.md | ||
| vivit.md | ||
| vjepa2.md | ||
| wav2vec2_phoneme.md | ||
| wav2vec2-bert.md | ||
| wav2vec2-conformer.md | ||
| wav2vec2.md | ||
| wavlm.md | ||
| whisper.md | ||
| xclip.md | ||
| xglm.md | ||
| xlm-prophetnet.md | ||
| xlm-roberta-xl.md | ||
| xlm-roberta.md | ||
| xlm-v.md | ||
| xlm.md | ||
| xlnet.md | ||
| xls_r.md | ||
| xlsr_wav2vec2.md | ||
| xmod.md | ||
| yolos.md | ||
| yoso.md | ||
| zamba.md | ||
| zamba2.md | ||
| zoedepth.md | ||