feat: add Windows CUDA GPU model support with NSIS installer#1
Merged
Conversation
Add GPU-accelerated Parakeet model support on Windows via NVIDIA CUDA, with runtime detection, bundled ONNX Runtime DLLs, an NSIS installer with prerequisite checks, and a rewritten model management system. Model management: - Overhaul model.rs with CUDA detection (CUDA_PATH/CUDNN_PATH env vars) - Add HuggingFace multi-file download support for GPU model variants - Add Whisper Small/Medium/Turbo/Large, Moonshine Base, and Parakeet V2/V3 in both CPU (INT8) and GPU (FP32) variants - GPU models only visible when CUDA + cuDNN are detected at runtime Build and installer: - Add NSIS installer hooks checking for CUDA/cuDNN prerequisites - Add build.rs logic to copy ONNX Runtime DLLs for Windows builds - Add CI step to download ONNX Runtime GPU DLLs during workflow - Bundle onnxruntime*.dll in resources/gpu-deps (DLLs gitignored) - Change Windows build target to NSIS-only Runtime: - Setup GPU DLL PATH in lib.rs for ONNX Runtime + CUDA discovery - Update transcription manager for CUDA-aware engine loading Dependency changes: - Update transcribe-rs to use git fork with CUDA support - Dependency bumps (tauri, tauri-apps packages) - Frontend updates for new model variants Also includes: documentation and changelog updates. Cleanup: - Remove upstream-specific GitHub templates (FUNDING, issue/PR templates) Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>
Resolves conflicts in: - .gitignore (kept both .onnxruntime/ and Playwright dirs) - package.json (kept Playwright test + newer @tauri-apps/cli@2.10.0) - bun.lock (regenerated after package.json merge)
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Add GPU-accelerated Parakeet model support on Windows via NVIDIA CUDA, with runtime detection, bundled ONNX Runtime DLLs, an NSIS installer with prerequisite checks, and a rewritten model management system.
Model management:
Build and installer:
Runtime:
Dependency changes:
Also includes: documentation and changelog updates.
Cleanup: