Skip to content

Feature Request: Add SenseVoice/Paraformer as STT model option #440

Description

@LauraGPT

Feature Request

Kalosm provides instant, controllable local AI models in Rust. Suggesting SenseVoice as a STT model option alongside Whisper.

Why SenseVoice for Kalosm?

  • Non-autoregressive — simpler inference implementation (no beam search/autoregressive loop)
  • 5x faster than Whisper — better for real-time/interactive use
  • 234M params — lighter weight
  • 50+ languages — good multilingual coverage
  • ONNX available — models exportable to ONNX for Rust integration via ort/tract
  • GGML availableFunASR-GGML provides GGUF format models

Rust integration paths

  1. ONNX Runtime (via ort crate): SenseVoice ONNX models available
  2. GGML (via ggml-rs): FunASR-GGML provides GGUF models
  3. C bindings: Sherpa-ONNX has a C API that could be wrapped

The non-autoregressive architecture means the Rust implementation would be simpler than Whisper — a single forward pass produces all tokens without needing an autoregressive decoding loop.

Resources

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions