Skip to content

How to increase the context window, if you have some RAM. #3

Description

@jonsmirl

https://github.com/jonsmirl/ssa

Subquadratic Sparse Attention (SSA)
Content-routed sparse attention for long contexts — exact softmax over a selected subset of keys (a bounded, dropped-mass error versus full attention), with the theory that says when it is sound and the experiments that measure it.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions