Skip to content

Missing MixMerLlamaAttention_drop Function in kv_token_merge.modify_llama #3

Description

@rainstorm12

Description
In the code located at /LOOK-M-main/LLaVA-mix_merge_v1/llava/model/language_model/llava_llama.py, there is an import statement that attempts to import multiple functions from the module kv_token_merge.modify_llama. However, it appears that the function MixMerLlamaAttention_drop is missing from the specified module.
Code Snippet

from ..kv_token_merge.modify_llama import H2OLlamaAttention_drop, MixMerLlamaAttention_drop \
                                            PixelPrunMergeAttention, \
                                            PixelPrunMergeDecoderLayer, \
                                            PixelPrunMergeAttentionLeft, \
                                            PixelPrunMergeDecoderLayerLeft, \
                                            PixelPrunMergeLlamaModel, \
                                            WeightedLlamaAttention_drop, \
                                            PivotMergeLlamaAttention_drop, \
                                            TextH2OLlamaAttention_drop, \
                                            TextWeightedLlamaAttention_drop, \
                                            TextPivotLlamaAttention_drop, \
                                            PoolingWindowLlamaAttention_drop, \
                                            AVGMergeLlamaAttention_drop, \
                                            MeanH2OLlamaAttention_drop, \
                                            TextAVGMergeLlamaAttention_drop

Problem
The function MixMerLlamaAttention_drop is referenced in the import statement, but it does not exist in the kv_token_merge.modify_llama module. This discrepancy may lead to runtime errors when the code attempts to use this function.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions