Description
In the code located at /LOOK-M-main/LLaVA-mix_merge_v1/llava/model/language_model/llava_llama.py, there is an import statement that attempts to import multiple functions from the module kv_token_merge.modify_llama. However, it appears that the function MixMerLlamaAttention_drop is missing from the specified module.
Code Snippet
from ..kv_token_merge.modify_llama import H2OLlamaAttention_drop, MixMerLlamaAttention_drop \
PixelPrunMergeAttention, \
PixelPrunMergeDecoderLayer, \
PixelPrunMergeAttentionLeft, \
PixelPrunMergeDecoderLayerLeft, \
PixelPrunMergeLlamaModel, \
WeightedLlamaAttention_drop, \
PivotMergeLlamaAttention_drop, \
TextH2OLlamaAttention_drop, \
TextWeightedLlamaAttention_drop, \
TextPivotLlamaAttention_drop, \
PoolingWindowLlamaAttention_drop, \
AVGMergeLlamaAttention_drop, \
MeanH2OLlamaAttention_drop, \
TextAVGMergeLlamaAttention_drop
Problem
The function MixMerLlamaAttention_drop is referenced in the import statement, but it does not exist in the kv_token_merge.modify_llama module. This discrepancy may lead to runtime errors when the code attempts to use this function.
Description
In the code located at /LOOK-M-main/LLaVA-mix_merge_v1/llava/model/language_model/llava_llama.py, there is an import statement that attempts to import multiple functions from the module kv_token_merge.modify_llama. However, it appears that the function MixMerLlamaAttention_drop is missing from the specified module.
Code Snippet
Problem
The function MixMerLlamaAttention_drop is referenced in the import statement, but it does not exist in the kv_token_merge.modify_llama module. This discrepancy may lead to runtime errors when the code attempts to use this function.