Skip to content

How to configure a third party model supporting 1M context gracefully #332

Description

@shaoyucheng
Image

Now i can only manually edit the model id,and it will be overwrited when configuration was changed somewhere else.

In cc-switch ui, there is a checkbox for this feature, but i didn't find it in cli.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions