Skip to content

MTP support and being able to customize the launch arguments #228

Description

@liquidbear99

In Open WebUI we should be able to add launch arguments to models such as:
-m C:\models\gemma-4-12b-it-qat.gguf --host 127.0.0.1
--port 10000 --ctx-size 4096
-fa on --spec-type draft-mtp
--spec-draft-n-max 1

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions