Skip to content

Number of ablation vectors for calculating linear datamodeling score (LDS) #8

@jonas-peschel

Description

@jonas-peschel

Hi! I am trying to reproduce some of the results from your paper Section 4, i.e. calculating the top-k log-prob drop and LDS metrics. For the LDS calculation you are sampling m random ablation vectors (stated in Definition 2.3), however I can't seem to find any information on what exact value for m you used in your experiments to get the LDS. So I wanted to ask how many ablation vectors did you sample? Sorry if I just overlooked this and thank you for the great project!

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions