Skip to content

first LiDB results are unplausible #4

Description

@aviadmx

Has anyone managed to achieve plausible results in the first stage of training the LiDB?
If so, would you share your dataset and config?

I do not understand why this is this first step necessary at all, as it should be difficult achieving plausible results using a 1 rank LoRA on any dataset.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions