Skip to content

How to evaluate cognition (reasoning) tasks with Micro-Bench #7

@WuWanyu98

Description

@WuWanyu98

Hello, thank you very much for your outstanding work. I followed the evaluation code you provided for the CLIP-style model on the Micro-Bench dataset (https://colab.research.google.com/drive/1EqXJYYenj_3s6a4KMBhPT0mvurrYFqDW?usp=sharing), but noticed that the output does not include the cognitive (reasoning) task. Could you please provide more detailed instructions regarding this task? Thanks a lot!

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions