mirror of
https://github.com/huggingface/transformers.git
synced 2025-07-29 09:12:21 +06:00
9bec2654ed
* adding model and conversion scripts * add imports to test vjepa conversion * fix imports and make conversion work * fix computation for short side * replace attention with library attention function * cleanup more attention classes * remove config overrides * add test cases, fix some of the failing ones * fix the model outputs * fix outputs of the model per review * fix too big model test case * fix styling __init__.py * fix initialization test * remove all asserts per review * update sorting unsorting logic as per feedback * remove is_video per review * remove another is_video segment * remove unwanted stuff * small fixes * add docstrings for the model * revert adding vjepa2 config here * update styling * add config docstrings (wip) * fix dpr issue * removed test failing issues * update styles * merge predictor configs into main config * remove processing code, add video processor * remove permute which is not necessary now * fix styles * updated vjepa2 to be in video_processing_auto * update comment for preprocessing * test integration test and fix the outputs * update test values, change test to look at repeated frames for a given image * add a simple video processing test * refactoring pixel_values_videos and upload ckpts to original * fix torch_fx test cases * remove unused config * add all config docstrings * add more integration tests * add basic doc * revert unwanted styling changes * working make fixup * Fix model_type in config * Add ForVideoClassification model * update attention implementation to fit new hf standards * fix the preprocessing logic, ensure it matches the original model * remove use_rope logic, cleanup * fix docstrings * Further cleanup, update doc * Fix model prefix * fix get_vision_features * VJEPA2Embeddings style refactor * nit, style comment * change modules default values * Only `str` activation in config * GradientCheckpointingLayer * fixup * fix conversion script * Remove return_dict * remove None return typehint * Refactor VJEPA2Layer, remove use_SiLU * Fix fx tests * dpr -> drop_path_rates * move *ModelOutput on top * format docs bit * update docs * update docs * update doc example * remove prune_heads from model * remove unused config params * refactor embed signature * Add vjepa to docs * Fix config docstring * attention head * update defaults * Update docs/source/en/model_doc/vjepa2.md Co-authored-by: Pedro Cuenca <pedro@huggingface.co> * Update docs/source/en/model_doc/vjepa2.md Co-authored-by: Pedro Cuenca <pedro@huggingface.co> * Fix import * Min refactoring * Update HUB_SOURCE and HUB_REPO in conversion script * Add missing headers * VJEPA -> V-JEPA in docs * Add image to doc * fix style * fix init weights * change checkpoint name in modeling tests * Initial cls head setup * remove rop attention from head (not needed) * remove swigluffn - not needed * Add siglip layer * Replace with siglip layer * Rename Siglip - VJEPA2 * remove unused modules * remove siglip mlp * nit * remove MLP * Refactor head cross attention * refactor VJEPA2HeadCrossAttentionLayer * nit renaming * fixup * remove commented code * Add cls head params to config * depth from config * move pooler + classifier to the model * Update for cls model signature * move layers, rename a bit * fix docs * update weights init * remove typehint for init * add to auto-mapping * enable tests * Add conversion script * fixup * add to docs * fix docs * nit * refactor for mapping * clean * Add integration test * Fixing multi gpu test * update not-split-modules * update video cls test tolerance * Increase test_inference_image tolerance * Update no-split modules for multi gpu * Apply suggestions from code review * fixing multi-gpu * fix docstring * Add cls snippet to docs * Update checkpoint |
||
|---|---|---|
| .. | ||
| internal | ||
| main_classes | ||
| model_doc | ||
| quantization | ||
| reference | ||
| tasks | ||
| _config.py | ||
| _redirects.yml | ||
| _toctree.yml | ||
| accelerate.md | ||
| accelerator_selection.md | ||
| add_new_model.md | ||
| add_new_pipeline.md | ||
| agents.md | ||
| attention_interface.md | ||
| attention.md | ||
| auto_docstring.md | ||
| backbones.md | ||
| cache_explanation.md | ||
| chat_extras.md | ||
| chat_templating_multimodal.md | ||
| chat_templating_writing.md | ||
| chat_templating.md | ||
| community.md | ||
| contributing.md | ||
| conversations.md | ||
| custom_models.md | ||
| debugging.md | ||
| deepspeed.md | ||
| executorch.md | ||
| fast_tokenizers.md | ||
| feature_extractors.md | ||
| fsdp.md | ||
| generation_features.md | ||
| generation_strategies.md | ||
| gguf.md | ||
| glossary.md | ||
| how_to_hack_models.md | ||
| hpo_train.md | ||
| image_processors.md | ||
| index.md | ||
| installation.md | ||
| kv_cache.md | ||
| llm_optims.md | ||
| llm_tutorial_optimization.md | ||
| llm_tutorial.md | ||
| model_memory_anatomy.md | ||
| model_sharing.md | ||
| model_summary.md | ||
| models.md | ||
| modular_transformers.md | ||
| notebooks.md | ||
| optimizers.md | ||
| pad_truncation.md | ||
| peft.md | ||
| perf_hardware.md | ||
| perf_infer_cpu.md | ||
| perf_infer_gpu_multi.md | ||
| perf_infer_gpu_one.md | ||
| perf_torch_compile.md | ||
| perf_train_cpu_many.md | ||
| perf_train_cpu.md | ||
| perf_train_gaudi.md | ||
| perf_train_gpu_many.md | ||
| perf_train_gpu_one.md | ||
| perf_train_special.md | ||
| perf_train_tpu_tf.md | ||
| perplexity.md | ||
| philosophy.md | ||
| pipeline_gradio.md | ||
| pipeline_tutorial.md | ||
| pipeline_webserver.md | ||
| pr_checks.md | ||
| processors.md | ||
| quicktour.md | ||
| run_scripts.md | ||
| serialization.md | ||
| serving.md | ||
| task_summary.md | ||
| tasks_explained.md | ||
| testing.md | ||
| tf_xla.md | ||
| tflite.md | ||
| tokenizer_summary.md | ||
| tools.md | ||
| torchscript.md | ||
| trainer.md | ||
| training.md | ||
| troubleshooting.md | ||
| video_processors.md | ||