An error occurred when evaluating:
ValueError: Incompatible shapes for attention inputs:
query.shape: torch.Size([20, 9216, 64])
key.shape : torch.Size([40, 77, 64])
value.shape: torch.Size([40, 77, 64])
HINT: We don't support broadcasting, please use expand yourself before calling memory_efficient_attention if you need to
what should I do to solve this?
An error occurred when evaluating:
ValueError: Incompatible shapes for attention inputs:
query.shape: torch.Size([20, 9216, 64])
key.shape : torch.Size([40, 77, 64])
value.shape: torch.Size([40, 77, 64])
HINT: We don't support broadcasting, please use
expandyourself before callingmemory_efficient_attentionif you need towhat should I do to solve this?