Skip to content

The test pair set in evaluation is different from other released code #4

Description

@care77

Hi, @ZiweiXU @daoyuan98 . I find that the test pair set for evaluation (line197-204) is less than other released code (line 225-250).
For example,

  1. MIT-States contains 1262 pairs in train set, 300/300 seen/unseen pairs in val set, 400/400 seen/unseen pairs in test set;
  2. when evaluated on test set, test pair set contains 800 pairs in Relation-CZSL but 1262 + 400 pairs in ExplainableML-czsl.

Is it a mistake here?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions