Eval mismatch for youcook2 to the paper

[JianHangChen]

Hello, here is I got from eval for youcook2 using TimeChat-7b checkpoint.

In your faq, you mentioned that "In our evaluation, the performance of the released ckpt on YouCook2 is higher than that in the paper."

However, this is what I got from the reproducing eval:

dvc

youcook2

                reproduce                        paper (0-shot)
SODA_c        0.8(SODA_c_2)                         1.2
CIDER           2.2                                 3.4
F1_Score        7.6                                12.6