Skip to content

evaluation metric questions #2

Description

@JoonHo-Jang

I want to ask you whether the calculation of 'known_acc' is correct or not, which is line number 169 in eval.py.

In my understanding, 'per_class_acc' in the function of 'test' has a length of (n.share+1). And, since 'open_class' is defined as "open_class = int(out_t.size(1))" in line 108, it is a "num_class = n_share + n_source_private".

However, the known accuracy is calculated by "known_acc = per_class_acc[:open_class - 1].mean()" in line 169.

Thus, when n_source_private>0, i think it covers all dimensions of per_class_acc.

In my thinking, it should be "known_acc = per_class_acc[:- 1].mean()" in line 169.

Please clarify my concerns.
Thank you.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions