riaz.somc/transformers
1
0
Fork 0
mirror of https://github.com/huggingface/transformers.git synced 2025-07-31 02:02:21 +06:00
Code Issues Actions 23 Packages Projects Releases Wiki Activity

Enable device map (#30870)

Browse Source 
* added_no_split_modules

* added LlavaNextVisionAttention to _no_split_modules
This commit is contained in:
Darshana S 2024-05-17 17:20:24 +05:30 committed by GitHub
parent 57c965a8f1
commit 3802e786ef
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
src/transformers/models/video_llava/modeling_video_llava.py
View File

@ -124,6 +124,7 @@ class VideoLlavaPreTrainedModel(PreTrainedModel):
supports_gradient_checkpointing = True
_skip_keys_device_placement = "past_key_values"
_supports_flash_attn_2 = True
_no_split_modules = ["VideoLlavaVisionAttention"]
def _init_weights(self, module):
# important: this ported version of VideoLlava isn't meant for training from scratch - only