questions with the implementation of the pairwise term

[liberty-hit]

Hi, @chengchunhsu , thanks for your implementation. When I test the model, I found the mask generated by the model is strange, there are some bad points in the mask like that

And I found that, in Sec 3.3, you write that

but in your implementation here, it seems that you multiply each pairwise term with its score value. Maybe this difference causes the mask problem? Please check it.

Thanks, looking forward to your reply